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President  and  Members: 

The  Controller’s  Audits  Division  presents  its  report  on  the  review  of  the  agreement  the 
Public  Utilities  Commission  (PUC)  of  the  City  and  County  of  San  Francisco  (City)  has 
with  the  San  Francisco  Water  Alliance  (alliance)  to  procure  program  management  and 
construction  management  services  in  support  of  the  PUC’s  water,  power,  and  sewer  capital 
improvement  program.  This  audit  is  the  first  in  a series  of  audits  the  controller  will  be 
conducting  of  the  agreement  between  the  PUC  and  the  alliance. 

We  reviewed  invoices  submitted  by  the  alliance  and  paid  by  the  PUC  covering  the  period 
from  October  2000  through  February  2001  and  found  that  the  alliance  generally  complied 
with  the  compensation  provisions  of  its  agreement  with  the  PUC.  While  we  found  that  the 
alliance  submitted  invoices  as  required  in  the  agreement  along  with  documents  to  support 
its  charges,  the  alliance  made  minor  errors  in  paying  some  of  its  staff.  Also,  the  alliance 
needs  to  inform  the  PUC  of  changes  in  staff  and  overhead  rates.  Furthermore,  the  alliance 
requested  reimbursements  for  some  unallowable  direct  costs.  Nevertheless,  the  PUC  finds 
the  alliance  to  be  performing  satisfactory  work.  Finally,  the  PUC  needs  to  clarify  several 
provisions  in  its  agreement  with  the  alliance. 
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SUMMARY 


Audit  Highlights... 

The  following  was 
revealed  in  our  audit  of 
the  San  Francisco 
Water  Alliance: 

0 The  alliance 

generally  complied 
with  payment 
provisions,  but  made 
minor  errors  in 
paying  some  of  its 
staff. 

0 The  alliance 

incorrectly  billed  for 
some  unallowable 
other  direct  charges. 

0 The  alliance  is 
satisfactorily 
completing  tasks. 

0 Several  provisions  in 
the  alliance’s 
agreement  with  the 
PUC  need  to  be 
changed  or  clarified. 


RESULTS  IN  BRIEF 


The  San  Francisco  Water  Alliance  (alliance)  generally 

complied  with  the  compensation  provisions  of  its  agreement 
with  the  Public  Utilities  Commission  (PUC)  of  the  City  and 
County  of  San  Francisco  to  provide  program  management  and 
construction  management  services  in  support  of  the  PUC’s  water, 
power,  and  sewer  capital  improvement  program.  We  reviewed 
invoices  totaling  $1,771,009  that  the  alliance  submitted  for 
services  rendered  from  October  2000  through  February  2001,  and 
which  the  PUC  approved.  While  the  alliance  submitted  its  invoices 
as  required  in  the  agreement  along  with  records  and  documents  to 
support  its  charges,  the  alliance  made  minor  errors  in  paying  some 
of  its  staff  and,  as  a result,  the  PUC  overpaid  the  alliance  $2,473. 


We  also  noted  other  areas  in  which  the  alliance  did  not  always 
comply  with  the  agreement’s  provisions.  The  alliance  did  not 
always  identify  the  names  of  the  staff  that  would  be  assigned  to  the 
tasks  when  it  submitted  task  orders  for  the  PUC’s  approval.  The 
agreement,  however,  requires  that  the  PUC  pre-approve  the 
assignment  of  staff  and  any  changes  of  staff  proposed  by  the 
alliance.  The  alliance  also  incorrectly  billed  the  PUC  $2,766  for 
other  direct  charges,  such  as  refreshments  and  lunches,  relocation 
costs,  and  certain  travel  costs,  that  are  not  specifically  identified  as 
allowable  charges  in  the  agreement.  The  alliance  corrected  this  by 
deducting  the  total  amount  from  its  other  charges  in  subsequent 
invoices. 


Because  most  of  the  tasks  that  have  been  ordered  by  the  PUC  are 
long  term  in  nature  and  were  still  in  the  start-up  phase  during  the 
period  of  our  review,  we  could  not  review  the  results  of  the  work. 
Nevertheless,  the  alliance  had  completed  eight  tasks  at  the  time  of 
our  review,  and  the  PUC  found  the  alliance  performing  satisfactory 
work.  According  to  the  PUC’s  project  manager,  the  alliance  is 
satisfactorily  performing  the  services  outlined  in  the  agreement.  He 
added  that  the  alliance  has  provided  timely  and  accurate  progress 
reports  for  the  tasks  that  are  still  in  process. 

During  our  review,  we  identified  several  provisions  in  the 
agreement  that  should  be  changed  or  clarified.  The  agreement,  for 
example,  does  not  allow  the  alliance  to  be  reimbursed  for  any  taxes 
it  pays  when  purchasing  materials  and  equipment  that  will  become 
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the  property  of  the  PUC.  While  the  PUC  has  reimbursed  the 
alliance  for  all  of  the  sales  taxes  paid  by  the  alliance  for  required 
equipment  purchases,  the  agreement  should  not  require  the  alliance 
to  be  responsible  for  any  taxes  that  result  from  the  alliance 
performing  its  services  in  accordance  with  the  agreement.  The 
PUC  also  should  clarify  that  the  alliance  needs  the  written  approval 
of  the  PUC  before  it  incurs  other  direct  charges.  Finally,  the  PUC 
and  the  alliance  do  not  agree  as  to  who  is  to  pay  for  the  audits  of 
the  overhead  rates  of  the  alliance's  members.  The  audits  must  be 
completed  before  the  end  of  September  2001  and  the  audited  rates 
will  be  applied  retroactively  to  the  approved  invoices  submitted  by 
the  alliance  members  for  the  previous  year  of  the  contract.  Both  the 
PUC  and  the  alliance  believe  that  the  other  party  is  responsible  for 
the  costs. 
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INTRODUCTION 


BACKGROUND 

The  Public  Utilities  Commission  (PUC)  of  the  City  and 

County  of  San  Francisco  (City)  has  a professional  services 
agreement  (agreement)  with  the  San  Francisco  Water 
Alliance  (alliance),  a joint  venture  of  Bechtel  Infrastructure 
Corporation,  The  Jefferson  Company,  and  Sverdrup  Civil,  Inc.,  to 
procure  program  management  and  construction  management 
services  in  support  of  PUC’s  water,  power,  and  sewer  capital 
improvement  program.  The  agreement  requires  the  alliance  to 
provide  overall  direction  and  guidance  to  the  program,  provide 
project  and  construction  management  services  to  individual 
projects,  and  provide  technical  support  services  primarily  in 
defining  engineering  needs,  optimizing  the  selection  of  design 
alternatives,  and  providing  technical  expertise  to  manage  workload 
peaks. 

The  term  of  the  agreement  is  for  four  years  and  was  approved  by 
the  Board  of  Supervisors  (board)  on  September  8,  2000.  Unless  the 
City’s  Office  of  the  Controller  (controller)  certifies  first  the 
availability  of  funds  for  each  specific  task  identified  by  the  PUC, 
the  alliance  cannot  furnish  any  services  and  cannot  be  paid  for  any 
work.  In  addition,  the  term  of  the  agreement  cannot  be  extended 
unless  the  City’s  Civil  Service  Commission  and  the  board  approve 
a modification.  Annually,  the  board  is  to  approve  the  continuation 
of  the  agreement  for  another  year  and  the  controller  is  to  certify  the 
availability  of  funds  for  that  year.  If  the  board  disapproves  a 
subsequent  annual  phase  of  the  agreement,  the  agreement  is 
terminated  without  liability  on  the  part  of  the  City  to  the  alliance. 

The  PUC  is  to  compensate  the  alliance  in  monthly  payments  within 
thirty  days  upon  the  alliance’s  presentation  of  a satisfactory 
invoice  for  work  it  performed.  The  total  amount  to  be  paid  under 
the  agreement  is  not  to  exceed  $45  million.  Furthermore,  the  PUC 
is  not  to  make  any  payments  to  the  alliance  until  it  provides  the 
PUC  with  the  reports  or  services  it  requires  under  the  agreement. 

The  agreement  requires  the  PUC,  through  the  controller,  to 
conduct  an  audit  of  the  alliance’s  costs  and  performance  in 
accordance  with  the  agreement  at  least  semi-annually.  This  report 
is  the  first  in  a series  of  audits  the  controller  will  be  conducting  of 
the  agreement  between  the  PUC  and  the  alliance. 
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SCOPE  AND  METHODOLOGY 


The  purpose  of  this  audit  was  to  determine  if  the  alliance  complied 
with  the  provisions  of  its  agreement  with  the  PUC,  specifically,  the 
compensation  provisions  of  the  agreement.  We  reviewed  the  terms 
of  the  agreement  and  assessed  the  alliance’s  procedures  for  billing 
the  PUC  and  the  PUC’s  procedures  for  paying  the  alliance.  We 
reviewed  all  invoices  for  services  rendered  by  the  alliance  from 
October  2000  through  February  2001,  to  determine  if  the  requests 
for  payments  were  properly  supported  and  did  not  exceed  budgeted 
amounts.  We  reviewed  payroll  costs  to  determine  if  the  labor  rates 
the  alliance  billed  to  PUC  were  in  accordance  with  the  agreement. 
We  also  reviewed  other  direct  charges  listed  in  the  invoices  to 
determine  if  those  charges  were  allowed  by  the  agreement.  Finally, 
we  reviewed  the  evaluations  prepared  by  the  PUC  for  the  task 
orders  completed  by  the  alliance. 


AUDIT  RESULTS 


The  PUC  paid  the 
alliance  $1,741,485  in 
approved  invoices. 


THE  ALLIANCE  GENERALLY  COMPLIED 
WITH  THE  COMPENSATION  PROVISIONS 
OF  ITS  AGREEMENT  WITH  THE  PUC 

The  San  Francisco  Water  Alliance  generally  complied  with 
the  compensation  provisions  of  its  agreement  with  the 
Public  Utilities  Commission.  While  the  alliance  submitted 
its  invoices  as  required  in  the  agreement  along  with  records  and 
documents  to  support  its  charges,  the  alliance  made  minor  errors  in 
paying  some  of  its  staff.  The  alliance  also  did  not  always  identify 
the  names  of  the  staff  that  would  be  assigned  to  the  tasks  when  it 
submitted  task  orders  for  the  approval  by  the  PUC.  Finally,  the 
alliance  requested  reimbursement  for  some  unallowable  other 
direct  costs. 


The  Alliance  Correctly 
Submitted  Its  Invoices 

We  reviewed  invoices  totaling  $1,771,009  that  the  alliance 
submitted  for  services  rendered  from  October  2000  through 
February  2001,  and  which  the  PUC  approved.  From  November  1, 
2000,  through  May  1,  2001,  the  PUC  paid  the  alliance  $1,741,485 
for  these  invoices.  However,  an  invoice  totaling  $29,524  was  not 
paid  because  the  invoice  did  not  identify  the  specific  source  of 
funds  that  was  to  be  used  to  pay  the  invoice.  The  alliance  withdrew 
the  invoice,  identified  the  source  of  the  funds,  and  subsequently 
resubmitted  it  for  payment  on  April  10,  2001. 

The  alliance  submitted  an  additional  $1,189,730  in  invoices  for 
services  provided  after  February  2001.  The  alliance  submitted 
invoices  for  March  2001,  totaling  $504,744,  on  April  27,  2001.  It 
then  submitted  invoices  for  April  2001,  totaling  $684,986,  on 
June  8,  2001.  The  alliance  received  a partial  payment  of  $461,319 
from  the  PUC  on  July  5,  2001,  for  the  March  invoices.  As  of  July 
12,  2001,  the  alliance  has  not  received  any  other  payments. 
According  to  the  agreement,  the  PUC  should  pay  the  alliance 
within  thirty  days  of  receipt  of  a satisfactory  invoice.  According  to 
PUC’s  project  manager,  some  of  the  invoices  that  were  submitted 
in  April  and  June  contained  expenses  that  required  further 
explanation  and  documentation.  Although  the  PUC  should  not  pay 
any  invoices  that  require  further  explanation  and  documentation. 
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The  alliance  charged 
incorrect  hourly  rates 
for  four  employees. 


the  PUC  needs  to  ensure  that  it  pays  satisfactory  invoices  within 
thirty  days  of  receipt.  At  a minimum,  those  invoices  submitted  on 
April  27,  2001,  and  June  8,  2001,  that  the  PUC  found  satisfactory 
and  approved  for  payment  should  have  been  paid  by  May  27, 

2001,  and  July  8,  2001,  respectively. 

For  the  period  we  reviewed,  we  found  that  the  alliance  submitted 
invoices  as  required  in  the  agreement.  We  reviewed  supporting 
documents,  such  as  timesheets,  and  found  them  to  be  in  order.  In 
reviewing  the  hourly  rates  of  the  alliance  staff,  we  found  that  the 
alliance  billed  hourly  rates  for  four  employees  that  exceeded  the 
rates  that  the  alliance  should  have  billed  the  PUC.  We  also  found 
that  the  controller  certified  the  availability  of  funds  before  the  PUC 
paid  the  alliance. 


The  Alliance  Made  Minor  Errors 
in  Paying  Some  of  Its  Staff 

The  alliance  incorrectly  increased  the  hourly  rates  for  two 
employees.  We  found  that  the  approved  hourly  rate  for  one 
employee  is  $56.83.  However,  the  alliance  increased  the 
employee’s  hourly  rate  to  $59.60  as  a result  of  a positive 
performance  evaluation  for  the  employee.  For  another  employee 
the  approved  hourly  rate  is  $57.58,  but  the  alliance  also  increased 
the  employee’s  hourly  rate  to  $57.95.  The  agreement  provides  that 
direct  labor  rates  can  be  adjusted  annually,  and  the  first  adjustment 
cannot  be  made  earlier  than  six  months  after  the  start  of  the 
agreement.  Since  the  alliance  increased  the  hourly  rates  before  six 
months  had  elapsed,  the  alliance  incorrectly  increased  the  hourly 
rate  for  the  two  employees  and  the  PUC  overpaid  the  alliance 
$1,427. 

In  addition,  one  of  the  alliance’s  sub-consultants  paid  two  of  its 
employees  at  lower  pay  rates  than  it  billed  the  PUC.  The 
agreement  requires  the  alliance,  including  its  sub-consultants,  to 
pay  employees  at  the  rates  it  bills  the  PUC.  We  reviewed  the 
salaries  paid  to  the  sub-consultant’s  employees  in  one  month  and 
found  that  the  sub-consultant  paid  one  of  its  employees  an  hourly 
rate  of  $32.3 1 . However,  the  alliance  billed  the  PUC  for  an  hourly 
rate  of  $33.93,  or  $ 1 .62  per  hour  more  than  it  should  have  billed. 
Similarly,  the  sub-consultant  paid  another  employee  an  hourly  rate 
of  $24.04.  However,  the  alliance  billed  the  PUC  for  an  hourly  rate 
of  $25.24,  or  $ 1 .20  per  hour  more  than  is  should  have  billed.  Based 
on  the  number  of  hours  reported  for  the  two  employees,  the  PUC 
overpaid  the  alliance  $1,046. 
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The  alliance  billed  the 
PUC  $2,766  in 
unallowable  direct 
charges. 


The  Alliance  Did  Not  Identify  Specific 
Staff  Assigned  to  Task  Orders 

The  PUC  approved  some  task  orders  for  the  alliance  to  complete 
without  ensuring  that  the  alliance  identified  the  names  of  the  staff 
that  would  be  assigned  to  the  tasks.  Instead,  the  alliance  only 
identified  in  the  task  orders  the  specialty  area  of  the  staff  that 
would  be  assigned  to  complete  the  task.  The  agreement  requires 
that  the  PUC  pre-approve  the  assignment  of  staff  and  any  changes 
of  staff  proposed  by  the  alliance.  Therefore,  it  is  important  that  the 
alliance  identify  the  specific  staff  members  and  their  hourly  rates 
of  pay  to  ensure  that  only  pre-approved  alliance  and  sub-consultant 
employees  are  assigned  to  work  on  the  tasks.  According  to  the 
alliance’s  business  manager,  the  alliance  had  not  yet  identified 
staff  members  who  would  be  working  on  the  tasks  when  it 
prepared  the  task  orders  for  the  PUC’s  approval. 


The  Alliance  Submitted  Reimbursement  Requests  for 
Costs  That  Are  Not  Allowable  in  the  Agreement 

The  alliance  billed  the  PUC  $2,766  out  of  a total  of  $75,943  in 
other  direct  charges  that  are  not  specifically  identified  as  allowable 
charges  in  the  alliance’s  agreement  with  the  PUC.  The  alliance 
requested  reimbursement  for  these  other  direct  costs  in  invoices  it 
submitted  covering  the  period  from  October  2000  through 
February  2001.  Although  the  PUC  approved  and  paid  these 
invoices,  these  other  direct  charges  are  not  specifically  identified 
as  allowable  charges  in  the  agreement. 

The  agreement  limits  other  direct  costs  to  out-of-town  travel 
(outside  of  San  Francisco),  messenger  services,  specialty  printing, 
specialized  software  and  hardware,  specialized  services,  and 
materials  and  necessary  equipment  in  PUC  offices  or  construction 
sites  that  is  not  provided  by  the  PUC.  Further,  the  agreement 
provides  that  all  other  direct  charges  are  reimbursable  at  cost  and 
must  be  approved  in  advance  by  the  manager  of  the  Utilities 
Engineering  Bureau.  Flowever,  we  found  that  the  alliance  billed 
the  PUC  for  refreshments  and  lunches  totaling  $848,  telephone 
charges  totaling  $666,  relocation  costs  of  $1,073,  and  travel  costs 
totaling  $179  for  Muni  fares  and  fast  passes,  and  taxi  fares.  The 
alliance  corrected  this  by  deducting  in  its  April,  May,  and  June 
2001  invoices  a total  of  $2,766  for  all  the  unallowable  other  direct 
charges  we  identified. 


7 


The  Alliance  Needs  to  Inform 
The  PUC  About  Changes  in 
Assigned  Work  Locations 


The  alliance  does  not 
inform  the  PUC  about 
changes  in  staff  work 
locations. 


The  alliance  does  not  inform  the  PUC  about  changes  in  assigned 
work  locations  of  alliance  staff  The  alliance  charges  the  PUC 
either  a home  office  overhead  rate  or  a field  office  overhead  rate 
depending  on  the  assignment  of  the  staff  The  home  office  rate  is 
higher  than  the  field  office  rate  and  is  used  when  the  employee  is 
assigned  to  work  at  the  consultanf  s offices.  The  field  office  rate  is 
used  when  the  staff  is  assigned  to  work  in  the  PUC  offices  or 
construction  sites.  However,  we  found  that  the  alliance  charged 
both  types  of  overhead  rates  for  two  of  its  staff.  The  alliance 
charged  a field  office  rate  of  1 1 5%  for  one  of  its  staff,  but  also 
later  charged  a home  office  rate  of  125%  for  the  same  employee. 
Similarly,  the  alliance  charged  a home  office  rate  of  163%  for 
another  employee,  but  later  charged  a field  office  rate  of  113%. 
According  to  the  alliance’s  business  manager,  the  alliance  charges 
staff  overhead  rates  based  on  assignment  locations  of  three  months 
or  less,  and  are  subject  to  change  as  the  alliance  moves  staff 
between  the  home  office  and  field  office.  However,  according  to 
the  PUC’s  project  manager,  the  PUC  was  not  aware  that  the 
alliance  had  been  reassigning  staff  between  the  home  and  field 
offices.  Since  the  total  overhead  charges  to  the  PUC  will  vary 
depending  on  the  assigned  location  of  the  alliance’s  employees,  it 
is  important  that  the  alliance  infoiTn  the  PUC  whenever  the  alliance 
reassigns  the  location  of  its  staff  so  that  the  PUC  can  verify  that  the 
alliance  is  charging  the  correct  overhead  rates. 


THE  PUC  GENERALLY  FOUND  THE 
ALLIANCE’S  WORK  SATISFACTORY 

The  PUC  prepares  a written  evaluation  at  the  completion  of  every 
task  performed  by  the  alliance.  The  alliance  is  rated  on  four 
criteria:  quality  of  the  work  and  deliverables,  adherence  to  project 
schedule,  adherence  to  project  budget,  and  task  management.  The 
PUC  rates  the  alliance  using  the  descriptions  of  poor,  needs 
improvement,  meets  requirements,  exceeds  requirements,  or 
excellent.  We  converted  the  descriptions  to  a numerical  five  point 
scale  with  poor  being  equivalent  to  1,  and  excellent  being 
equivalent  to  5.  The  results  of  the  evaluations  given  by  the  PUC  to 
the  alliance  are  presented  in  the  appendix,  and  are  summarized  in 
the  table  below.  Most  of  the  tasks  that  have  been  ordered  by  the 
PUC  are  long  term  in  nature  and  were  still  in  the  start-up  phase 
during  the  period  of  our  review.  According  to  the  PUC’s  project 
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manager,  the  alliance  is  satisfactorily  performing  the  services 
outlined  in  the  agreement.  He  added  that  the  alliance  has  provided 
timely  and  accurate  progress  reports  for  the  tasks  that  are  still  in 
process. 

The  tasks  that  the  alliance  completed  are  shown  in  the  table  below 
and  include  the  purchases  of  project-specific  insurance  policies 
that  total  $251,198  for  the  first  year  of  the  agreement.  The 
insurance  policies  are  required  by  the  agreement  and  insure  the 
alliance,  its  sub-consultants,  and  the  City. 


TABLE 


San  Francisco  Water  Alliance 
Completed  Task  Orders 


Task 

Order 

Description 

Budget 

Actual 

Cost 

Average 

Evaluation 

Score* 

1 

Insurance  Policies 

$251,198 

$251,198 

3 

2 

Start-up  & Team  Building 

95,000 

71,983 

3 

4 

Owner  Controlled  Insurance  Program  Risk 
Assessment 

19,460 

12,187 

4 

7 

Reliability  Phase  III  Planning 

9,500 

5,763 

5 

8 

Millbrae  Administration  Building  Bid  Evaluation 

3,000 

1,677 

3 

9 

Sunol  Improvement  Project  Bid  Evaluation 

19,900 

17,981 

3 

11 

Moccasin  Administration  Building  Bid  Evaluation 

800 

559 

4 

12 

Priest  Reservoir  Constructibility  Review 

4,800 

2,904 

3 

Total 

$403,658 

$364,252 

*5=Excellent 

4=Exceeds  Requirements 
3=Meets  Requirements 
2=Needs  Improvement 
1=Poor 


THE  PUC  NEEDS  TO  CLARIFY  PROVISIONS 
IN  ITS  AGREEMENT  WITH  THE  ALLIANCE 

During  our  review,  we  identified  several  provisions  that  need  to  be 
changed  or  clarified  in  the  PUC’s  agreement  with  the  alliance.  For 
example,  the  agreement  requires  the  alliance  to  pay  any  taxes, 
including  possessory  interest  taxes  and  California  sales  and  use 
taxes,  and  does  not  allow  the  alliance  to  be  reimbursed  for  the 
taxes.  The  PUC  requires  the  alliance  to  purchase  materials  and 
equipment,  reimburses  the  alliance  for  the  costs,  and  the  materials 
and  equipment  become  the  property  of  the  PUC.  Since  the  City  is 
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not  exempt  from  paying  sales  taxes,  the  PUC  should  also 
reimburse  the  alliance  for  any  taxes  it  pays.  Currently,  the  PUC  has 
reimbursed  the  alliance  for  all  of  the  sales  taxes  paid  by  the 
alliance  for  required  equipment  purchases.  However,  the 
agreement  should  not  require  the  alliance  to  be  responsible  for  any 
taxes  that  result  from  the  alliance  performing  its  services  in 
accordance  with  the  agreement.  In  addition,  the  PUC  should  buy 
its  own  materials  and  equipment  using  the  City’s  purchasing 
guidelines  rather  than  requiring  the  alliance  to  make  such 
purchases.  We  will  evaluate  future  invoices  to  assess  whether  the 
PUC  is  avoiding  the  City’s  purchasing  requirements  by  requiring 
the  alliance  to  buy  materials  and  equipment. 

The  agreement  also  requires  the  manager  of  the  Utilities 
Engineering  Bureau  to  approve  in  advance  any  other  direct  charges 
incurred  by  the  alliance.  We  interpret  the  agreement  to  mean  that 
advance  written  approval  is  required  for  the  alliance  to  make  any 
other  direct  charges.  We  did  not  find  any  written  evidence  that  the 
manager  of  the  Utilities  Engineering  Bureau  approved  in  advance 
the  alliance’s  other  direct  charges. 


Also,  according  to  the  agreement,  the  PUC’s  general  manager 
needs  to  approve  the  report  or  services  submitted  by  the  alliance 
before  payments  are  made.  We  found  that  only  the  PUC  project 
managers  approved  the  invoices  submitted  by  the  alliance  for 
services  it  performed  when  paying  the  invoices.  If  the  PUC 
believes  that  the  general  manager’s  approval  is  not  formally 
required,  then  it  should  amend  its  agreement  to  reflect  the  current 
practice. 


The  PUC  and  the 
alliance  must  decide 
who  should  pay  for 
overhead  audits. 


Finally,  there  is  a provision  in  the  agreement  that  requires  the 
Bechtel  Infrastructure  Corporation  to  coordinate  with  the  other 
alliance  members  to  produce  an  audit  of  the  overhead  costs  and 
resulting  rates  for  each  member.  The  audits  must  be  completed 
before  the  end  of  September  2001.  The  audited  rates  will  be 
applied  retroactively  to  the  approved  invoices  submitted  by  the 
alliance  members  for  the  previous  year  of  the  contract.  The 
payments  will  be  adjusted  upwards  or  downwards,  depending  upon 
the  results  of  the  audit.  The  approved  audited  overhead  rate  will 
also  be  used  for  the  next  year  of  the  agreement.  Currently,  there  is 
disagreement  as  to  who  is  to  pay  for  the  cost  of  the  audits.  Both  the 
PUC  and  the  alliance  believe  that  the  other  party  is  responsible  for 
the  cost. 
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RECOMMENDATIONS 


To  ensure  that  the  alliance  complies  with  the  compensation 

provisions  of  its  agreement  with  the  Public  Utilities  Commission, 

the  PUC  should  take  the  following  actions: 

, Ensure  that  satisfactory  invoices  are  paid  within  thirty  days  of 
receipt. 

, Ensure  that  the  alliance  and  its  sub-consultants  are  billing  the 
proper  rate  for  its  employees  by  verifying  that  the  employees’ 
hourly  rates  in  the  invoices  are  the  same  as  the  hourly  rates  the 
employees  are  actually  being  paid,  as  long  as  the  rates  do  not 
exceed  the  amounts  allowed  by  the  agreement.  The  PUC 
should  also  require  the  alliance  to  reduce  future  invoices  by  the 
amounts  that  were  overpaid  as  a result  of  the  incorrectly 
charged  employee  hourly  rates. 

, Require  the  alliance  to  indicate  in  the  task  orders  the  names  of 
the  employees  who  will  be  assigned  to  conduct  the  work  and 
their  rates  of  pay. 

, Make  sure  all  parties  are  in  agreement  as  to  what  constitutes 
other  direct  costs  that  will  be  reimbursed  by  the  PUC.  The  PUC 
should  determine  whether  relocation  costs,  telephone  charges, 
and  travel  costs  are  allowable  other  direct  costs.  If  the  PUC 
concludes  that  these  costs  should  be  allowable,  it  should  amend 
the  agreement  to  specifically  identify  these  other  direct  charges 
not  currently  identified  in  the  agreement. 

, Provide  guidelines  to  its  staff  who  review  and  approve  invoices 
so  that  they  know  what  are  allowable  costs  for  reimbursement. 

, Require  the  alliance  to  notify  the  PUC  when  the  alliance  and  its 
sub-consultants  change  the  overhead  rates  for  its  employees 
when  assigned  to  different  work  locations. 

To  clarify  the  provisions  in  its  agreement  with  the  alliance,  the 

PUC  should  take  the  following  actions: 

, Rescind  the  provision  requiring  the  alliance  to  be  responsible 
for  the  payment  of  any  taxes  resulting  from  the  alliance 
performing  its  duties  in  accordance  with  the  agreement.  In 
addition,  the  PUC  should  purchase  its  own  materials  and 
equipment,  using  the  City’s  purchasing  guidelines  rather  than 
requiring  the  alliance  to  make  such  purchases. 
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. Consider  amending  its  agreement  if  it  believes  that  the 

approval  of  the  PUC’s  general  manager  is  not  required  but  that 
designated  staff  can  approve  all  reports  and  services. 
Otherwise,  the  approval  of  the  PUC’s  general  manager  is 
required  before  making  any  payments  to  the  alliance. 

. Clarify  who  is  responsible  for  paying  for  the  audits  of  the 
alliance  members’  overhead  rates  and  ensure  that  the  audits  are 
completed  by  September  30,  2001 . 


We  conducted  this  review  according  to  generally  accepted  government  auditing  standards.  We 
limited  our  re\  iew  to  those  areas  specified  in  the  audit  scope  section  of  this  report. 


Staff:  Camien  LeFranc,  Audit  Manager 
Leon  Valle,  Jr. 

Patricia  Wu 


cc:  Mayor 

Board  of  Supervisors 
Civil  Grand  Jury 
Budget  Analyst 
Public  Library 
KPMG  LLP 
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APPENDIX 


PUC  Evaluations  of  San  Francisco  Water  Alliance 
Completed  Task  Orders 


Evaluation  Scores  * 


Completed 

Task 

Order 

Description 

Quality 

of 

Work 

Adherence 
to  Project 
Schedule 

Adherence 
to  Project 
Budget 

TiiR 

Management 

1 

Insurance  Policies 

3 

3 

3 

4 

2 

Start-up  & Team  Building 

4 

2 

4 

3 

4 

Owner  Controlled  Insurance 
Program  Risk  Assessment 

4 

2 

5 

4 

7 

Reliability  Phase  ill 
Planning 

5 

5 

5 

5 

8 

Millbrae  Administration 
Building  Bid  Evaluation 

3 

3 

3 

3 

9 

Sunol  Improvement  Project 
Bid  Evaluation 

3 

3 

4 

3 

11 

Moccasin  Administration 
Building  Bid  Evaluation 

4 

4 

4 

5 

12 

Priest  Reservoir 
Constructibility  Review 

3 

3 

4 

3 

5=Excellent 

4=Exceeds  Requirements 
3=Meets  Requirements 
2=Needs  Improvement 
1=Poor 
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niank  inscrh  i!  h>r  rcpnxlin  fion  luirjuncs  only. 


SAN  FRANCISCO  PUBLIC  UTILITES  COMMISSION 
RESPONSE  TO  THE  AUDIT: 


San  Francisco  Pubuic  utilities  Commission 

1155  Morttet  St . 4lh  Floor,  San  Frandsco.  CA  34103  • Tel  (415)  554-3155  • Fax  (415)  554-3151 


July  18,  2001 


Water 

HETCH  HETCHY 
WATER  a Power 
CLEAN  WATER 


Subject:  San  Francisco  Water  Alliance  (SFWA)  Contract  Audit 
Report  Audit  Number:  00043 


WILLIE  L.  BROWN,  JR. 
MAYOR 


E.  DENNIS  NORMANDY 
FRANK  L.  COOK 
ASHOK  KUMAR  BHATT 


ANN  MOLLER  CAEN 
VICE  PRESIDENT 


VICTOR  G.  MAKRAS 
PRESIDENT 


Edward  Harrington 
Controller 

City  and  County  of  San  Francisco 
City  Hall 

San  Francisco,  CA  94103 


STEVEN  D-  LEONARD 
ACTING  GENERAL  MANAGER 


Dear  Mr.  Harrington: 


The  SFPUC  would  like  to  thank  Nori  Hirasuna,  Carmen  Le  Franc  and  their 
colleagues  for  conducting  the  first  semi-annual  audit  for  the  SFWA  contract. 
The  intent  of  this  audit  was  to  evaluate  the  proper  management  of  the  SFWA 
costs  and  performance  in  accordance  with  the  agreement.  We  agree  vJth  the 
overall  conclusion  by  the  Audit  team.  We  have  prepared  responses  to  each  of 
the  recommendations  provided  by  the  Controller’s  Office  (Please  see 
attachment). 

Again,  I appreciate  the  efforts  of  your  office  in  conducting  this  audit  in  a 
professional  way. 


Attachment: 

SDL/MQ'JB 

cc:  Ed  West 

Jeet  Bajwa 
Kate  Read 


Very  truly  yours. 


Acting  General  Manager 
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Attachment  1 


Audit  of  the  San  Francisco  Water  Alliance 
Response  of  the  SFPUC 
July  17.  2001 
Page  1 


The  Alliance  Correctly  Submitted  Its  Invoices 

Recommendation:  Ensure  the  satisfactory  payment  of  invoices  within 
thirty  days  of  receipt. 

Response;  In  general,  the  invoices  are  being  paid  within  30  days. 
However,  there  have  been  some  specific  instances  where  the  SFWA 
invoices  needed  further  clarifications  as  mentioned  in  the  audit  report.  To 
expedite  invoice  payment,  an  electronic  check  transfer  system  is  being 
implemented. 

The  Alliance  Made  Some  Errors  in  Paying  Some  of  Its  Staff 

Recommendation:  Ensure  that  the  alliance  and  its  sub-consultants  are 
billing  the  proper  rate  for  its  employees  by  verifying  that  the  employees’ 
hourly  rates  in  the  invoices  are  the  same  as  the  hourly  rates  the  employees 
are  actually  being  paid,  as  long  as  the  rates  do  not  exceed  the  amounts 
allowed  by  the  agreement.  The  SFPUC  should  also  require  the  alliance  to 
reduce  future  invoices  by  the  amounts  that  were  overpaid  as  a result  of  the 
incorrectly  charged  employee  hourly  rates. 

Response:  The  SFPUC  has  asked  the  SFWA  to  reimburse  the  SFPUC  in 
a future  invoice  by  the  overpaid  amount  identified  in  the  audit  report. 
Furthermore,  the  SFPUC  has  requested  that  the  SFWA  ensure  that  their 
employee’s  hourly  rates  are  the  same  on  the  invoices  as  what  they  are 
actually  paid  in  salary. 

The  Alliance  Did  Not  Identify  Specific  Staff  Assigned  to  Task  Orders 

Recommendation:  Require  the  alliance  to  indicate  in  the  task  orders  the 
names  of  the  employees  who  will  be  assigned  to  conduct  the  work  and 
their  rates  of  pay. 

Response:  As  a general  practice,  the  SFWA  task  order  proposals  include 
scope,  schedule  and  budget.  The  budget  is  supported  by  the  job  hours  and 
the  estimated  other  direct  costs.  The  job-hour  estimate  is  based  on  the 
staff  grade  level  and  job  hours  to  be  spent.  In  most  of  the  cases,  the  staff 
names  are  identified.  However,  in  the  early  stages  of  the  program  the 
names  of  the  staff  were  not  identified  in  several  cases.  Unless  the  SFWA 
has  a large  pool  of  staff  waiting  for  assignments,  it  is  not  possible  to 
identify  each  staff  member  during  the  proposal  stage  of  task  order. 


Attachment  1 


Audit  of  the  San  Francisco  Water  Alliance 
Response  of  the  SFPUC 
July  17,  2001 
Page  2 


During  the  proposal  phase,  the  key  staff  members  are  identified  along  with 
the  required  grade  level  for  the  other  staff  members.  Once  a task  order  is 
approved  and  the  new  staff  is  added  to  a task  order  their  approval  is 
secured. 

The  Alliance  Submitted  Reimbursement  Requests  for  Costs  That  Are 
Not  Allowable  in  the  Agreement 

Recommendation; 

1.  Determine  whether  relocation  costs,  telephone  charges,  and  travel 
costs  are  allowable  other  direct  costs.  If  the  SFPUC  concludes  that 
these  costs  should  be  allowable,  it  should  amend  the  agreement  to 
specifically  identify  these  other  direct  costs  not  currently  identified  in 
the  agreement. 

2.  Provide  guidelines  to  its  staff  that  review  and  approve  invoices  so 
that  they  know  what  are  allowable  costs  for  reimbursement. 

Response: 

1.  Currently,  all  Other  Direct  Charges  (ODCs)  are  evaluated  for 
compliance  with  the  contract  and  the  Federal  Acquisition 
Regulations  (FAR). 

2.  There  are  separate  invoices  for  SFWA  staff  costs  and  ODCs  in 
order  to  better  analyze  costs.  The  SFPUC  staff  has  disallowed  many 
ODCs.  is  reviewing  invoices  for  other  costs  that  might  be  ineligible 
and  has  directed  the  SFWA  to  have  potential  future  ODCs  pre- 
approved. 

The  Alliance  Needs  to  Inform  the  PUC  When  It  Charges  Different 
Overhead  Rates  Depending  Upon  the  Location  of  the  Employee 

Recommendation:  Require  the  alliance  to  notify  the  PUC  when  the  alliance 
changes  the  overhead  rates  for  employees. 

Response;  The  overhead  rates  referred  above  are  tied  to  the  work 
location,  either  the  Home  Office  Rates  (work  performed  at  an  SFWA  office) 
or  the  Field  Rate  (work  performed  at  a SFPUC  location.)  To  address  this 
problem,  the  SFWA  has  been  directed  to  obtain  prior  approval  from  the 
SFPUC  project  manager  for  changing  the  work  location. 


Attachment  1 


Audit  of  the  San  Francisco  Water  Alliance 
Response  of  the  SFPUC 
July  17.  2001 
Page  3 


SFWA  Contract  Clarifications 

To  clarify  the  provisions  in  its  agreement  with  the  alliance,  the  PUC  should 
take  the  following  actions; 

• Rescind  the  provision  requiring  the  alliance  to  be  responsible  for  the 
payment  of  any  taxes  resulting  from  the  alliance  performing  its  duties  in 
accordance  with  the  agreement.  In  addition,  the  PUC  should  purchase 
its  own  materials  and  equipment,  using  the  City’s  purchasing  guidelines 
rather  than  requiring  the  alliance  to  make  such  purchases. 

Response:  The  SFPUC  will  reimburse  all  sales  taxes  paid  by  the  SFWA 
for  all  materials  and  equipment  purchased  for  their  use  on  this  project.  The 
SFPUC  has  not  asked  the  SFWA  to  purchase  any  materials  or  equipment 
for  SFPUC  staff. 

• Consider  amending  its  agreement  if  it  believes  that  the  approval  of  the 
SFPUC’s  General  Manager  is  not  required  but  that  designated  staff  can 
approve  all  reports  and  services.  Otherwise,  the  approval  of  the 
SFPUC's  General  Manager  is  required  before  making  any  payments  to 
the  alliance. 

Response;  The  SFPUC  General  Manager  shall  issue  instructions 
regarding  the  approval  of  the  SFWA  invoices,  delegating  the  approval 
authority  on  his  tDehalf. 

• Clarify  who  is  responsible  for  paying  for  the  audits  of  the  alliance 
members'  overhead  rates  and  ensure  that  the  audits  are  completed  by 
September  30,  2001. 

Response:  The  SFWA  is  coordinating  the  development  of  auditable 
overhead  rates  for  all  of  its  subconsultants,  as  required  by  the  contract. 


SAN  FRANCISCO  WATER  ALLIANCE 
RESPONSE  TO  THE  AUDIT: 


July  16.  2001 


Mr.  Edward  Harrington  - Controller 
City  & County  of  San  Francisco 
1 Dr.  Carlton  B.  Goodlett  Place 
San  Francisco,  CA  94102-4694 


In  reply,  please  refer  to:  CCN  00730 


Subject;  Comments  on  Audit  Findings 


Dear  Mr.  Harrington: 

We  would  like  to  thank  you.  Carmen  LeFranc  and  her  staff  for  this  semi-annual  audit  of  the  SFWA  costs 
and  performance  for  this  contract  year.  Your  findings  will  allow  us  to  analyze  specific  areas  of  our 
contract,  and  it  is  our  intent  to  work  with  the  SFPUC  to  clarity  provisions  in  our  contract  to  address  your 
findings.  We  very  much  appreciate  your  staff’s  effort  in  this  area. 

We  note  that  the  findings  are  minor  and  that  you  have  stated  that  “The  Alliance  Correctly  Submitted  its 
Invoices"  and  that  the  "SFPUC  generally  found  the  Alliance’s  work  satisfactory".  Our  goal  now  is  to 
improve  our  processes  so  that  there  are  zero  findings  on  the  next  audit. 


We  have  prepared  responses  to  each  of  the  audit  result  sections  and  to  the  recommendations  contained 
in  your  audit  report.  These  responses  are  presented  on  the  attached  together  with  our  findings. 


John  W.  Kluesener 
p/ogram  Director 
■San  Francisco  Water  Alliance 
875  Stevenson  Street.  3"^  Floor 
San  Francisco,  CA  94103 


JWK/fmc 


Enclosure 


cc: 


Bajwa,  J 
Leonard,  S 
Quan,  ME 
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Response  to  Audit  Findings 


rintHn}>:  The  AUiance  Made  Some  Errors  in  Payin’;  Some  of  its  Stuff 

The  hourly  rates  in  Appendix  C of  tlie  Contract  are  described  as  average  base  salary  for  key 
iniliNidiuls.  At  (he  time  the  contract  was  signed  the  actual  salaries  for  a few  of  the  individuals 
\vere  not  known.  Tor  these  “a\erage  salary”  infonnation  was  generated  by  taking  the 
indiMdual's  grade  and  length  of  service  and  comparing  that  with  corporate  averages  for  that 
particular  grade.  This  is  the  prirntuy  reason  for  the  SO. 37  din'erence  between  the  a\crage  salary 
of  S57.5S  and  the  individual's  actual  salary  of  S57.05.  The  other  sttlary  dilTerential  noted  was 
the  dilTerence  berween  the  approved  rale  of  S56.83  and  the  rate  of  S59.60  as  billed.  This 
dilTerence  occurred  Ixx'ause  the  individual's  salaiy  was  increased  on  October  1 just  after  the 
contract  was  awarded. 

Dunng  the  negotiations,  it  was  explained  and  accepted  by  the  SFPUC  and  the  City  Attorney  that 
the  Bechtel  Systems  Infrastructure  Inc,  ol'  which  BINFR.A  is  a company,  has  established 
procedures  on  how  BINFRA  collects  costs,  distributes  overhead  and  handles  annual  raises. 
.Annual  raises  occur  in  either  October  or  .Apnl.  'Ihe  annual  corporate  average  salary  increase  is 
established  in  February  or  Mcu-ch  and  limits  the  value  of  overall  raises  within  the  company  to  that 
le\el.  This  process  was  also  explained  and  accepted  by  the  SFPUC  and  the  City  .Attorney's 
olTice.  The  increase  in  rales  due  to  fXTfoirnance  evaluation  was  finalized  in  April  of  2000  prior 
to  contract  K TP.  However,  as  stated  above,  it  was  not  implemented  until  the  appropriate  date  in 
October  in  accordance  with  Bechtel’s  procedures.  Once  the  contract  was  signed  we  then  billed 
the  employee  at  his  then  current  actual  salary  for  the  lew  days  in  .September  and  early  October 
2000.  We  then  billed  at  his  new  actual  sakuy-  of  S59.60  fiom  tlie  elTective  tlaie.  To  handle  this 
prcKcss  any  ditferently  would  put  Bechtel  in  violation  of  its  stanckird  business  practices.  Based 
on  this  we  do  not  believe  the  PUC  overpaid  the  Alliance  SI, 046. 

At  the  time  the  contract  was  negotiated,  both  the  SFPUC  and  the  SFW.A  had  assumed  that  the 
contract  would  bo  finalized  some  time  in  Octolxir.  Both  parties  also  assumed  that  any  .scheduled 
rate  increases  in  early  October  would  take  efTect  prior  to  contract  N TP.  Tlie  next  set  of  rate 
increases  w'ould  then  occur  in  .April.  6 months  after  the  October  NTP.  This  would  allow  all 
Bechtel  employees  to  receive  their  already  approved  rate  increa.ses  in  accoRkmce  with  BINFRA 
standard  procedures. 


Eindin};:  The  Alliance  did  not  Identify  Specific  Staff  Assigned  to  Task  Orders 

In  the  Contract,  Para  4.0  .sub  paragraph  (d)  states:  “Consultant  will  consult  with  and  obtain 

wnlten  authorization  from  the  City  before  adding  .stalT,  or  .sub  consultants  to  the  core  consultant 
team  beyond  that  .sjxtcified  in  Appendices  B and  C'." 


Julv  12, 
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Response  to  Audit  Findings 


The  referenced  appendices  include  the  Core  Team  (Appendix  B)  which  lists  the  core  Companies 
in  the  SFVVA  and  the  MAVBE  designations  and  key  personnel  and  sub  consultants  in  the  core 
SFWA  joint  venture  ptirtnership  (Appendix  C).  As  stated  in  the  alxtve  contract  reference,  the 
Alliance  has  not  added  staff  or  Sub-consultants  to  the  core  Consultant  team  beyond  that  specified 
in  Appendix  B and  Appendix  C.  Based  on  our  understanding  of  the  Contract  requirements  we 
do  not  believe  the  Alliance  neglected  to  obtiin  written  authorization  because  no  new  key 
personnel  or  sub -consultants  have  been  added  since  the  beginning  of  the  project.  Appendix  D, 
paragraph  titled  “Changes  of  Staff’  states:  “Tlie  SFPUC  General  Manager  must  pre-approve  the 
assignment  of  staff  to  hesin  the  program  and  any  changes  of  staff  proposed  by  Consultant”. 

We  have  interpreted  this  paragraph  to  relate  to  the  key  persons  and  core  tetuns  identificxl  in 
Appendices  B & C. 

All  of  the  core  key  SFWA  personnel  assigned  to  begin  the  program  in  OctolTcr  2000  are  still  a 
part  of  the  Alliance  team  and  no  new  core  key  members  have  been  added. 

It  is  not  possible  to  name  in  advance  the  exact  individuals  who  will  be  working  on  a task  uittil 
the  tosk  has  been  approved,  other  than  the  SFWA  Task  Order  Manager  who  is  identified  well  in 
advance.  The  Alliance  seeks  to  hire  staff  from  its  M and  WBE  partners  as  a first  priority  and 
small  sub  consultants  generally  do  not  have  staff  on  overhead  that  can  be  identified  and  assigned 
to  a task  order,  prior  to  receiving  a formal  approval  on  that  task  order  from  the  PUC. 

The  Alliance  identifies  the  grade,  yeans  of  experience  and  an  average  salary  based  on  its  own 
experience  for  that  position.  Once  the  Task  Order  is  approved  by  the  PUC,  the  Alliance  seeks  to 
hire  .VT'WBE  staff  to  fill  the  po.sitions  defined  in  the  task  order.  Candidates  are  generally 
interview'ed  by  the  SFPUC  PM  before  they  are  hired/'assigned  to  the  project.  After  an  individual 
has  accepted  the  offer,  the  Alliance  infomis  the  PUC  Task  Order  manager  of  the  staffing,  and 
provides  the  salary  information. 

We  will  seek  to  clarify  the  contract  on  this  issue  of  written  authorization. 

Finding:  The  Alliance  Submitted  Reimbursement  Requests  for  Costs  that  are  not 

Allowable  in  the  Agreement 

A corrective  Action  plan  with  regards  to  the  allowable  other  direct  costs  (ODC)  stipulated  in  the 
Contract,  is  underway  and  will  be  presented  to  the  PUC  separately  by  the  first  week  in  August 
2001. 

As  discussed  with  the  Sl-PUC  auditor,  the  lunches  and  refreshments  were  provided  by  the  SFWA 
per  a request  from  the  UEB.  The  Alliance  has  fully  credited  the  City  for  the  amounts  of  S848 
(refreshments).  S666  (telephone),  $1,073  (relocation  co.st.s),  $179  (travel  plus  Muni  Fast  Pa.sses) 
for  a total  of  $2,766. 
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Response  to  Audit  Findings 


With  a'gards  to  the  classifications  of  the  Muni  Fast  Pass  as  a Messenger  Service,  the  Fast  Pass  is 
used  to  expedite  transp<irting  pa[x;r\vork  within  the  project  and  the  Joint  Venture  home  otTices. 
The  fast  pass  allows  unlimited  trips  at  a set  price  of  S35'month.  The  current  messenger  service 
conies  once  a day  and  onlv  transports  documents  to  and  from  875  Stevenson  to  the  BINFRA 
inailroom  at  an  approximate  current  monthly  cost  of  S340. 

We  believe  that  based  on  the  serv  ices  involved.  tJic  Muni  Fast  Pass  fills  under  the  definition  of  a 
messenger  service.  The  use  of  a Muni  Fast  Pass  in  lieu  of  calling  a messenger  service  whenever 
something  must  be  expedited  is  a cost  savings  to  the  City  and  we  believe,  a prudent  business 
decision.  In  addition,  checks  sent  between  875  Stevenson  Street,  the  current  SFWA  location  and 
B1NFR.A  offices  at  333  .Market  Street,  cannot  be  .sent  via  a messenger  service.  Based  on  the 
economic  analysis  stated  above,  the  Alliance  will  recommend  to  tlie  PUC,  that  the  Mes.senger 
Services  definition  in  the  contract,  be  rev  ised  to  include  the  Muni  Fast  Pass. 

Finding:  The  Alliance  i\eeds  To  Inform  The  SFPUC  When  It  Charges  Different 

Overhead  Rates  Depending  Upon  The  Location  Of  The  Employee 

During  contract  negotiations.  BSIl  govenunent  charging  practices  were  explained  to  the  PUC, 
which  resulted  in  the  two  overhead  rates  being  included  in  the  Contract  for  all  members  of  the 
SFWA.  BSll's  chaiging  practices  arc  governed  by  FAR  and  monitored  and  audited  by  the 
Federal  DCAA.  Based  on  our  owti  charging  practices  and  the  FAR  requirements  specified  in 
this  contract,  we  are  required  to  charge  a Home  Office  overhead  rate  when  an  emplov'ee’s  period 
of  performance  on  a task  order  is  estimated  to  be  temporary.  In  such  cases,  the  parent  company 
of  the  individiml  is  required  to  maintain  a space  for  the  employee  at  the  Home  Office  location 
and  continues  to  incur  overhead  costs  for  that  employee.  When  an  assignment  changes  to 
permanent,  the  overhead  rate  is  changed  to  a project  office  rate. 

Both  the  PUC  and  SFW.\  agreed  to  include  the  two  rates  in  this  contract  to  allow  for  short  tenn 
and  long  tenn  tissignments.  During  contract  negotiations,  tlie  PUC  and  SFW'A  reached  a mutual 
agreement,  that  a temporary  assignment  would  be  defined  as  any  a.ssignmcnt  that  would  last  less 
than  3 months. 

The  increase  in  overhead  rates  from  115%  to  125%  and  the  decrease  in  overhead  rates  from 
163%  to  1 13%  were  both  due  to  a change  in  the  nature  of  the  employee's  assignment  on  a 
specific  task  order. 

The  increa.se  occurred  when  an  employee  who  was  on  a pennanent  assignment  at  the  project 
office  completed  that  a.ssignmcnt  and  went  back  to  the  home  office.  However,  ftrnn  time  to  time 
we  have  used  him  to  perfonn  specialised  cost  estimates  for  us.  The  higher  home  office  rate  is 
for  his  time  on  these  special  assignments.  'ITe  decrease  in  overhead  rates  occurred  when  an 
employee’s  origin;il  part-tenn  a.ssignment  was  replaced  by  a long-term  assignment  on  a new  task 
order. 
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Response  to  Audit  Findings 


In  the  flitiire  wc  will  make  every’  attempt  to  infonn  the  F’UC  manager  of  any  clianges  in  billing 
between  home  ofiice  and  project  office  rates. 

SFfyA  Audit  of  Sub  Consultants 

In  response  to  your  findings  regarding  the  audit  of  overhead  costs  of  each  Alliance  partner  by 
BINFRA,  we  are  pleased  to  infonn  you  that  BINFRA  has  started  liie  audit  process  as  understood 
by  the  SFWA. 

We  have  provided  fonnal  classroom  training  in  FAR  regulations,  and  have  oITcrcd  training 
material  on  interactive  Compact  Disk  fonnats  in  contract  Compliance  and  Ethics  to  Alliance 
team  members.  We  are  currently  in  the  process  of  verifying  that  the  project  office  rates  of  our 
sub  consultants  include  tlie  appropriate  line  items  allowed  by  FAR.  fliis  elTort  is  in  line  w'ith  the 
requirements  stated  in  our  contract  with  the  PUC. 

However,  since  BINFRA  is  not  a CPA  fimi,  we  cannot  perform  a full  financial  audit  of  our  sub 
consultant’s  books. 

Conclusions: 

We  concur  with  your  findings  tliat  tlie  City  should  pay  .satisfactory  invoices  within  30  days,  to 
avoid  undue  financial  hardship  for  our  minority  sub  consultants.  We  would  also  like  to  state  that 
when  a consultant  has  perfonned  specific  tasks  under  directions  of  the  PUC  staff  for  a period  of 
time  on  an  approved  task  order,  that  his  invoices  be  paid  by  the  City  when  submitted.  By  giving 
directions  to  a sub  consultant,  the  City  has  in  effect  approved  his  involvement  luid  the  work  done 
by  him. 

The  contract  is  not  clear  on  the  is.sue  of  obtaining  approval  for  all  .staff  assigned  to  a task  order 
prior  to  starting  the  w’ork.  We  will  work  witli  the  SFPUC  to  modify  the  contract  to  cktiify  this 
issue. 


Jiil>  12.2001. 
Page  4 of  4 


23 


, \i»  W,  , 

‘ " 

•4/  '''  ’.:.  ■■  !V-'  S'.vi.-:»  v.-()  ^ 


■,»v:' ■'''i  - r'-'^'j 


'riiV 


w- 


"'  ,,  ,,  ^^  *^ ''|/  *1 'jjP'.  » . ( '■■  ■ .'  ■ ■,  ■':■■  :;,  iraww*' i.,  ' .>■^5'.- 

;.  ’'■"li:;’;,,  / ■.;> ; ■■  ''.^  >-  :■  y^vik0.  ■ % 

■ ‘ '''-'''SfilP*-' '■'■'''■  #•  ' .'  -rtf, 

■'■'v^.’^w  • ',  ■:''^  . npH  - ,^|. . a;  tilt  ffki^ 


^ ■ ' . , 

^ SHfft  :! 


“> -■  wwjwnra'f'- 

-vA‘^  ' •' 


\ - ''^vd 


-;f  /IT 9 ■‘.;,  :-V;l 


SS'i' 


.•H)i  It 

''•■.^rr'"'^'''-''.'i.'r4;3 


! 


CITY  AND  COUNTY  OF  SAN  FRANCISCO 


PUBLIC  UTILITIES 
COMMISSION: 

Second  Review  of  the 
Professional  Services 
Agreement  With  the 
San  Francisco  Water  Alliance 

DOCUMENTS  DEPT. 

OCT  I 0 200! 

SAN  FRANCISCO 
PUBLIC  LIBRARY 


Audit  Number  01007 
October  2,  2001 


'M 


H'V 


’f'  a:;: 

^■'H  ,;j|^ 


V! 

.;.■  V' 

•-  • i 


ju 


’•  *;.'^  'a-a 


ii'iM 


: ... -;  '%'^l 


t 


) 


. '•=l90?Tl^3MUt^- 


t ■ .ot jau^ 


CITY  AND  COUNTY  OF  SAN  FRANCISCO 


OFFICE  OF  THE  CONTROLLER 


Edward  Harrington 
Controller 
Matthew  H.  Hymel 
Chief  Assistant  Controller 


October  2,  200 1 Audit  Number:  0 1 007 

Public  Utilities  Commission 
1155  Market  Street,  4^*^  Floor 
San  Francisco,  CA  94103 

President  and  Members: 

The  Controller’s  Audits  Division  presents  its  report  on  the  review  of  the  agreement  the 
Public  Utilities  Commission  (PUC)  of  the  City  and  County  of  San  Francisco  (City)  has 
with  the  San  Francisco  Water  Alliance  (alliance)  to  procure  program  management  and 
construction  management  services  in  support  of  the  PUC’s  water,  power,  and  sewer  capital 
improvement  program.  This  audit  is  the  second  in  a series  of  audits  the  Office  of  the 
Controller  will  be  conducting  of  the  agreement  between  the  PUC  and  the  alliance. 

We  reviewed  a sample  of  invoices  submitted  by  the  alliance  and  reviewed  by  the  PUC  as 
of  August  21,  2001.  The  PUC  had  completed  reviewing  invoices  submitted  through  July 
2001  for  services  rendered  for  March  2001  through  May  2001.  We  found  that  the  alliance 
generally  complied  with  the  compensation  provisions  of  its  agreement  with  the  PUC. 
Although  the  alliance  generally  submitted  invoices  as  required  in  the  agreement  along  with 
documents  to  support  most  of  its  charges,  the  alliance  and  its  sub-consultants  made  errors 
in  billing  the  PUC.  Furthermore,  the  PUC  approved  some  other  direct  charges  for 
reimbursement  to  the  alliance  without  sufficient  documents  to  support  the  charges. 
Nevertheless,  the  PUC  finds  the  alliance  to  be  performing  satisfactory  work. 

During  the  course  of  our  audit,  the  alliance  credited  the  PUC  for  the  billing  errors  we 
identified  and  provided  receipts  to  support  the  other  direct  charges  we  questioned. 
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SUMMARY 


Audit  Highlights. . . 

The  following  was 
revealed  in  our  audit  of 
the  San  Francisco 
Water  Alliance: 

El  The  alliance 

generally  complied 
with  payment 
provisions,  but  made 
errors  in  billing  the 
PUC. 

El  The  alliance  did  not 
always  submit 
required  documents 
to  support  other 
direct  charges. 

0 The  PUC  approved 
some  other  direct 
charges  without 
sufficient  support. 

0 The  PUC  finds  the 
alliance  is 
satisfactorily 
completing  tasks. 


RESULTS  IN  BRIEF 

The  San  Francisco  Water  Alliance  (alliance)  generally 

complied  with  the  compensation  provisions  of  its  agreement 
with  the  Public  Utilities  Commission  (PUC)  of  the  City  and 
County  of  San  Francisco  to  provide  program  management  and 
construction  management  services  in  support  of  the  PUC’s  water, 
power,  and  sewer  capital  improvement  program.  We  reviewed  a 
sample  of  invoices  submitted  by  the  alliance  and  reviewed  by  the 
PUC  as  of  August  21,  2001.  As  of  this  date,  the  PUC  had 
completed  reviewing  invoices  submitted  through  July  2001  for 
services  rendered  for  March  2001  through  May  2001.  We  reviewed 
the  payroll  costs  and  the  overhead  costs  included  in  a sample  of 
invoices  totaling  $478,640  out  of  $1,816,353  in  invoices  that  the 
alliance  submitted  for  the  audit  period.  While  the  alliance  generally 
submitted  its  invoices  as  required  in  the  agreement  along  with 
records  and  documents  to  support  its  charges,  the  alliance  and  its 
sub-consultants  made  errors  in  billing  the  PUC.  For  the  sample  of 
employee  salaries  we  reviewed,  we  found  that  the  alliance 
overbilled  the  PUC  $4,871  for  four  employees,  and  underbilled  the 
PUC  $1,271  for  one  other  employee.  The  net  result  is  that  the 
alliance  overbilled  the  PUC  $3,600  in  the  invoices  that  we 
reviewed.  The  alliance  subsequently  credited  the  PUC  for  the 
errors  we  identified. 

We  also  reviewed  all  the  other  direct  charges  the  alliance  requested 
for  reimbursement.  The  alliance  did  not  always  submit  required 
documents  to  support  its  requests  to  be  reimbursed  for  some  other 
direct  charges.  It  also  submitted  irrelevant  documentation  to 
support  some  other  direct  charges.  As  a result,  the  PUC  disallowed 
more  than  $27,000  of  the  $139,245  in  other  direct  charges  the 
alliance  requested  for  reimbursement. 

We  also  noted  that  the  PUC  approved  $8,730  in  payments  for  other 
direct  charges  but  did  not  receive  sufficient  documentation  from 
the  alliance  to  support  the  charges.  At  our  request,  the  alliance  was 
able  to  provide  receipts  for  all  the  charges  we  questioned. 

However,  the  alliance  should  always  provide  the  PUC  sufficient 
documents,  in  the  form  of  original  receipts,  to  support  the  other 
direct  charges  for  which  it  seeks  reimbursement. 

Finally,  the  PUC  continues  to  find  that  the  alliance  is  satisfactorily 
completing  tasks. 
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INTRODUCTION 


BACKGROUND 

The  Public  Utilities  Commission  (PUC)  of  the  City  and 

County  of  San  Francisco  (City)  has  a professional  services 
agreement  (agreement)  with  the  San  Francisco  Water 
Alliance  (alliance),  a joint  venture  of  Bechtel  Infrastructure 
Corporation,  The  Jefferson  Company,  and  Sverdrup  Civil,  Inc.,  to 
procure  program  management  and  construction  management 
services  in  support  of  PUC’ s water,  power,  and  sewer  capital 
improvement  program.  The  agreement  requires  the  alliance  to 
provide  overall  direction  and  guidance  to  the  program,  provide 
project  and  construction  management  services  to  individual 
projects,  and  provide  technical  support  services  primarily  in 
defining  engineering  needs,  optimizing  the  selection  of  design 
alternatives,  and  providing  technical  expertise  to  manage  workload 
peaks. 

The  term  of  the  agreement  is  for  four  years  and  was  approved  by 
the  Board  of  Supervisors  (board)  on  September  8,  2000.  Unless  the 
City’s  Office  of  the  Controller  (controller)  certifies  first  the 
availability  of  funds  for  each  specific  task  identified  by  the  PUC, 
the  alliance  cannot  furnish  any  services  and  cannot  be  paid  for  any 
work.  In  addition,  the  term  of  the  agreement  cannot  be  extended 
unless  the  City’s  Civil  Service  Commission  and  the  board  approve 
a modification.  Annually,  the  board  is  to  approve  the  continuation 
of  the  agreement  for  another  year  and  the  controller  is  to  certify  the 
availability  of  funds  for  that  year.  If  the  board  disapproves  a 
subsequent  annual  phase  of  the  agreement,  the  agreement  is 
terminated  without  liability  on  the  part  of  the  City  to  the  alliance. 

The  PUC  is  to  compensate  the  alliance  in  monthly  payments  within 
thirty  days  of  the  alliance’s  presentation  of  a satisfactory  invoice 
for  work  it  performed.  The  total  amount  to  be  paid  under  the 
agreement  is  not  to  exceed  $45  million.  Furthermore,  the  PUC  is 
not  to  make  any  payments  to  the  alliance  until  it  provides  the  PUC 
with  the  reports  or  services  it  requires  under  the  agreement. 

The  agreement  requires  the  PUC,  through  the  controller,  to 
conduct  an  audit  of  the  alliance’s  costs  and  performance  in 
accordance  with  the  agreement  at  least  semi-annually.  This  report 
is  the  second  in  a series  of  audits  the  controller  will  be  conducting 
of  the  agreement  between  the  PUC  and  the  alliance. 
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At  the  request  of  the  PUC,  this  audit  was  conducted  immediately 
after  the  prior  audit  was  completed  and  thus  both  the  PUC  and  the 
alliance  did  not  have  sufficient  time  to  correct  many  of  the  prior 
audit’s  findings.  As  a result,  our  current  audit  identified  some  of 
the  same  deficiencies  we  identified  in  our  first  audit. 


SCOPE  AND  METHODOLOGY 

The  purpose  of  this  audit  was  to  determine  if  the  alliance  complied 
with  the  provisions  of  its  agreement  with  the  PUC,  specifically,  the 
compensation  provisions  of  the  agreement.  We  reviewed  the  terms 
of  the  agreement  and  assessed  the  alliance’s  procedures  for  billing 
the  PUC  and  the  PUC’s  procedures  for  paying  the  alliance.  We 
reviewed  a sample  of  invoices  submitted  by  the  alliance  and 
reviewed  by  the  PUC  as  of  August  21,  2001.  As  of  this  date,  the 
PUC  had  completed  reviewing  invoices  submitted  through  July 
2001  for  services  rendered  for  March  2001  through  May  2001.  We 
reviewed  a sample  of  invoices  to  determine  if  the  requests  for 
payments  were  properly  supported  and  did  not  exceed  budgeted 
amounts.  We  reviewed  a sample  of  payroll  costs  to  determine  if  the 
labor  rates  the  alliance  billed  to  PUC  were  in  accordance  with  the 
agreement.  We  also  reviewed  all  the  other  direct  charges  listed  in 
the  invoices  to  determine  if  those  charges  were  allowed  by  the 
agreement.  Finally,  we  reviewed  the  evaluations  prepared  by  the 
PUC  for  the  task  orders  completed  by  the  alliance. 
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AUDIT  RESULTS 


THE  ALLIANCE  GENERALLY  COMPLIED  WITH 
THE  COMPENSATION  PROVISIONS  OF  ITS 
AGREEMENT  WITH  THE  PUC 

The  San  Francisco  Water  Alliance  generally  complied  with 
the  compensation  provisions  of  its  agreement  with  the 
Public  Utilities  Commission.  While  the  alliance  generally 
submitted  its  invoices  as  required  in  the  agreement  along  with 
records  and  documents  to  support  its  charges,  the  PUC  is 
sometimes  slow  in  paying  the  alliance.  We  also  found  that  the 
alliance  and  its  sub-consultants  made  errors  in  billing  the  PUC  for 
some  payroll  costs  by  using  incorrect  payroll  rates  for  some  staff. 
The  alliance  did  not  always  submit  required  documents  to  support 
its  requests  to  be  reimbursed  for  other  direct  charges.  We  also 
noted  that  the  PUC  approved  payments  for  other  direct  charges  but 
did  not  receive  sufficient  documentation  from  the  alliance  to 
support  the  charges. 


The  PUC  Is  Slow 
in  Paying  the  Alliance 


The  PUC  paid  the 
alliance  $1,766,777  in 
approved  invoices. 


The  alliance  submitted  invoices  totaling  $1,816,353  for  services 
rendered  from  March  2001  through  May  2001 . The  PUC  paid  the 
alliance  $1,766,777  of  the  total,  and  as  of  September  26,  2001,  is 
withholding  payment  of  $49,576  as  shown  in  the  table  below. 


TABLE 


San  Francisco  Water  Alliance 
invoices  Submitted  and  Paid 
As  of  September  26,  2001 


Number  of 
Invoices 

Invoice 

Amount 

Amount 

Paid 

Amount 
Not  Paid 

March  2001 

12 

$504,744 

$503,716 

$1,028 

April  2001 

20 

684,987 

668,925 

16,062 

May  2001 

22 

626,622 

594,136 

32,486 

Total 

54 

$1,816,353 

$1,766,777 

$49,576 
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The  alliance  billed 
incorrect  hourly 
rates  for  several 
employees. 


According  to  the  agreement,  the  PUC  should  pay  the  alliance 
within  30  days  of  receipt  of  a satisfactory  invoice.  However,  the 
PUC  often  paid  the  alliance  late.  For  example,  we  found  that  the 
PUC  paid  the  alliance  from  1 to  3 weeks  late  for  all  20  invoices  the 
alliance  submitted  in  June  2001  for  April  2001  services.  According 
to  the  PUC’s  project  manager,  the  PUC  did  not  pay  all  the 
expenses  on  the  invoices  because  some  of  the  billed  expenses 
required  further  explanation  and  documentation.  The  alliance’s 
business  manager  stated,  however,  that  the  PUC  did  not  promptly 
inform  the  alliance  so  that  it  could  correct  the  disallowances 
identified  by  the  PUC.  According  to  the  alliance’s  business 
manager,  the  alliance  has  designed  a form  for  the  PUC  to  use  to 
inform  the  alliance  whenever  the  PUC  questions  any  of  the 
charges. 

We  reviewed  a sample  of  invoices  totaling  $478,640  out  of 
$1,816,353  in  invoices  that  the  alliance  submitted  to  the  PUC.  For 
the  invoices  we  reviewed,  we  found  that  the  alliance  submitted 
most  of  the  invoices  as  required  in  the  agreement.  We  reviewed 
supporting  documents,  such  as  timesheets,  and  found  them  to  be  in 
order.  However,  we  found  that  the  alliance  made  errors  in  billing 
the  PUC  for  some  payroll  costs. 


The  Alliance  Made  Some  Errors 
In  Billing  the  PUC  for  Payroll  Costs 

The  alliance  and  its  sub-consultants  made  some  errors  in  billing  the 
PUC  for  some  payroll  costs.  In  our  previous  audit  report,  we 
identified  a few  instances  where  the  alliance  and  its  sub- 
consultants incorrectly  billed  the  PUC  for  some  payroll  costs  for 
certain  staff.  In  our  current  review,  we  reviewed  the  billing  rates 
for  a sample  of  employees  of  the  alliance  and  its  sub-consultants. 
We  found  that  the  alliance  and  some  sub-consultants  paid  four 
employees  at  lower  pay  rates  than  it  billed  the  PUC.  The 
agreement,  however,  requires  the  alliance  and  its  sub-consultants 
to  pay  employees  at  the  rates  it  bills  the  PUC.  The  PUC  overpaid 
the  alliance  by  $4,871  for  the  errors  the  alliance  and  the  sub- 
consultants made  in  billing  the  PUC.  The  alliance  also  made  an 
error  that  resulted  in  an  underpayment  to  the  alliance.  The  alliance 
did  not  bill  the  PUC  $1,271  for  the  work  of  one  of  its  employees. 
The  net  result  from  the  errors  was  that  the  PUC  overpaid  the 
alliance  and  its  sub-consultants  by  $3,600.  The  alliance 
subsequently  corrected  its  August  2001  invoices  to  take  into 
account  the  errors  we  identified. 
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In  addition,  in  reviewing  the  timesheets  submitted  by  one  of  the 
sub-consultants,  we  noted  that  two  employees  had  worked  in 
excess  of  eight  hours  in  a day.  While  one  of  the  employee’s 
timesheet  showed  that  fifteen  hours  of  overtime  was  disallowed, 
and  thus  not  charged  to  the  PUC  for  reimbursement,  the  other 
timesheets  showed  the  two  employees  worked  more  than  eight 
hours  in  a day  and  the  excess  hours  were  billed  to  the  PUC. 
Although  the  PUC  was  not  charged  time  and  a half  for  the  excess 
hours,  it  may  have  incorrectly  paid  for  those  hours  depending  upon 
the  employee’s  employment  status  and  the  compensation  policy  of 
the  sub-consultant.  The  two  employees  are  considered  exempt 
employees,  meaning  that  they  were  salaried  and  not  paid  in  excess 
of  eight  hours  per  day  or  eighty  hours  during  a two-week  time 
period. 

Appendix  D of  the  agreement  states  that  direct  labor  charges  are 
limited  to  actual  salaries  of  employees.  Although  the  sub- 
consultant allowed  the  employee,  who  billed  eighty-four  hours  in  a 
two  week  time  period,  to  earn  compensatory  time  off  for  the  four 
excess  hours  worked  and  charged  to  the  PUC,  the  agreement 
between  the  alliance  and  the  PUC  does  not  address  compensatory 
time.  In  addition,  the  sub-consultant’s  employee  handbook  states 
that  compensatory  time  is  capped  at  a maximum  amount  of  80 
hours  and  that  compensation  will  not  be  paid  for  any  unused 
accumulated  compensatory  time.  Therefore,  there  is  a possibility 
that  the  sub-consultant  may  not  pay  the  employees  for  the  hours 
billed  to  the  PUC. 

According  to  the  alliance’s  business  manager,  the  alliance  does  not 
have  an  agreement  with  the  PUC  to  pay  any  exempt  employees  on 
a special  flexible  schedule  that  would  allow  the  employees  to  work 
and  be  compensated  for  more  than  eight  hours  in  a day,  as  long  as 
the  hours  do  not  exceed  eighty  hours  during  a two-week  time 
period.  Because  there  is  no  policy  regarding  hours  worked  in 
excess  of  eight  hours  per  day,  the  PUC  may  be  overpaying  for 
those  excess  hours.  The  PUC  and  the  alliance  need  to  ensure  that 
the  employees  of  the  alliance  and  its  sub-consultants  are  paid  or 
compensated  for  any  hours  that  are  charged  to  the  PUC. 


The  Alliance  Did  Not  Always  Submit  Required 
Documents  to  Support  Charges  for  Other  Direct  Costs 

We  reviewed  all  of  the  other  direct  charges  the  alliance  submitted 
to  the  PUC.  Because  the  alliance  did  not  always  submit  required 
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The  PUC  disallowed 
$27,724  in  other  direct 
costs  because  of 
inadequate 
documentation  and 
irrelevant  support. 


documents  to  support  charges  for  other  direct  costs,  the  PUC 
disallowed  $27,724  of  the  $139,245  in  other  direct  costs  the 
alliance  requested  for  reimbursement.  According  to  the  PUC’s 
project  manager,  the  disallowed  charges  need  further  review  and 
documentation.  However,  as  in  the  other  disallowances  made  by 
the  PUC,  the  alliance  indicated  that  the  PUC  is  not  promptly 
informing  the  alliance  why  it  has  not  approved  the  charges. 

In  some  instances,  the  alliance  also  submitted  irrelevant 
documentation  that  did  not  specifically  support  the  request  for 
reimbursement  for  some  other  direct  charges.  As  a result,  the  PUC 
staff  could  not  reconcile  what  was  invoiced  by  the  alliance  to  the 
support  included  with  the  invoices.  Therefore,  the  PUC  did  not 
reimburse  the  alliance  for  those  charges.  For  example,  the  alliance 
provided  the  PUC  with  a nine-page  detailed  breakdown  for  $881  in 
telephone  charges  incurred  by  alliance  employees  in  one  of  the 
alliance’s  April  2001  invoices.  However,  the  alliance  did  not 
specifically  identify  the  amounts  that  the  alliance  requested  for 
reimbursement.  Instead,  the  alliance  simply  requested  to  be 
reimbursed  $643.  As  a result,  the  PUC  was  unable  to  verify  which 
charges  were  legitimate  business  expenses  and  which  calls  were 
personal,  and  thus  did  not  reimburse  the  alliance  for  that  portion  of 
the  invoice. 


In  another  instance,  the  alliance  submitted  over  forty  pages  of 
copies  of  receipts  for  one  of  its  employee’s  traveling  expenses. 
Although  the  receipts  included  unallowable  expenses,  the  alliance 
requested  reimbursement  for  per  diem  costs  that  did  not  include 
those  unallowable  expenses.  In  addition,  the  receipts  did  not  match 
the  $7,564  requested  for  reimbursement  and  there  was  no 
explanation  as  to  why  the  alliance  included  the  receipts.  The  PUC 
did  not  pay  the  alliance  the  amount  requested  for  reimbursement. 
By  submitting  irrelevant  documents,  the  alliance  created  confusion 
for  the  PUC  staff  and  caused  a delay  in  the  PUC  paying  the 
alliance.  The  PUC  and  the  alliance  need  to  establish  standards  as  to 
what  constitutes  sufficient  documents  to  be  included  as  support  to 
the  invoices  the  alliance  submits  to  the  PUC. 


In  addition,  to  determine  if  the  alliance  correctly  requested 
reimbursement  of  the  employee’s  travel  expenses,  we  reviewed  the 
employee’s  travel  expense  reports.  We  found  that  the  alliance 
reimbursed  the  employee  in  British  pounds  sterling  rather  than 
U.S.  dollars.  Because  the  alliance  based  its  reimbursement  request 
on  the  amount  of  pounds  paid  to  the  employee,  and  since  the 
conversion  rate  was  different  when  the  alliance  billed  the  PUC, 


I The  PUC  approved 
some  charges 
without  adequate 
supporting 
documentation. 


this  resulted  in  the  alliance  overbilling  the  PUC  by  $230  for  the 
reimbursement  of  the  employee’s  travel  expenses. 

We  calculated  the  amount  of  the  overbilling  by  comparing  the 
actual  dollar  amounts  the  employee  reported  for  reimbursement  to 
the  amount  the  alliance  billed  to  the  PUC.  According  to  the  PUC’s 
project  manager,  there  was  no  agreement  between  the  PUC  and  the 
alliance  to  reimburse  its  staff  in  other  currencies  besides  the  actual 
dollar  amount  incurred  by  its  staff  The  alliance  has  issued  a credit 
to  the  PUC  for  the  travel  expense  reimbursement  requests  that  we 
identified  and  will  submit  corrected  invoices  to  the  PUC. 

We  also  found  that  the  PUC  approved  reimbursement  of  some 
other  direct  charges  without  adequate  support.  The  alliance  did  not 
submit  receipts  to  support  $13,995  in  other  direct  charges.  Instead 
of  submitting  receipts  to  support  the  charges,  the  alliance 
submitted  a detailed  schedule  of  the  charges.  We  also  noted  that 
the  PUC  approved  for  payment  $8,730  of  the  unsupported  other 
direct  charges.  The  PUC  should  not  approve  payment  of  any  other 
direct  charges  without  original  receipts  fi*om  the  alliance.  We 
requested  the  alliance  to  provide  additional  receipts  to  support 
these  charges  and  the  alliance  did  provide  receipts  for  the  entire 
amount  we  questioned. 

The  alliance  also  submitted  reimbursement  requests  for  expenses 
totaling  $487  for  other  direct  costs  that  are  not  specifically  allowed 
in  the  agreement.  The  alliance  billed  the  PUC  for  $70  in  Muni  fast 
passes,  $120  in  training  costs,  $236  in  outside  services,  and  $61  in 
communication  costs  that  are  all  unallowable  charges.  According 
to  the  alliance’s  business  manager,  the  alliance  will  credit  the  PUC 
for  these  costs  on  its  next  invoice.  Because  we  identified  a $50 
underpayment  to  the  alliance  in  another  invoice  we  reviewed,  the 
alliance  need  only  credit  the  PUC  for  $437. 

Finally,  the  alliance  did  not  obtain  prior  approval  from  the  PUC’s 
manager  of  the  Utilities  Engineering  Bureau  before  incurring  any 
of  the  other  direct  costs  we  reviewed.  According  to  the  agreement, 
the  PUC’s  prior  approval  is  required  before  the  alliance  can  make 
purchases  that  fall  under  the  category  of  other  direct  charges. 
According  to  the  alliance’s  business  manager,  the  alliance  is 
seeking  blanket  approval  for  recurring  costs  such  as  messenger 
services.  According  to  her,  the  alliance  would  obtain  approval 
before  incurring  non-recurring  costs. 
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THE  PUC  GENERALLY  FOUND  THE 
ALLIANCE’S  WORK  SATISFACTORY 

The  PUC  continues  to  find  the  work  of  the  alliance  satisfactory. 

We  reviewed  28  evaluations  prepared  by  16  task  order  project 
managers.  On  average,  the  PUC  rated  the  alliance  to  be  meeting  or 
exceeding  requirements  for  the  tasks  undertaken  by  the  alliance 
and  its  sub-consultants.  The  evaluation  scores  for  the  tasks  are 
shown  in  the  appendix. 

The  PUC’s  task  order  project  managers,  many  of  whom  are  PUC 
engineers,  prepare  written  final  evaluations  at  the  completion  of 
every  task  performed  by  the  alliance  and  written  interim 
evaluations  for  projects  that  are  long  term  in  nature.  The  task  order 
project  managers  are  generally  the  PUC  employees  who  requested 
the  tasks  and  who  work  with  the  alliance  staff  to  ensure  that  the 
tasks  are  completed  to  the  satisfaction  of  the  PUC.  After  the  task 
order  project  manager  completes  the  evaluation,  the  evaluation  is 
forwarded  first  to  the  project  management  division  (PMD) 
representative  for  review  and  approval.  The  PMD  representative, 
usually  the  proj  ect  manager  for  the  alliance  contract,  then  forwards 
the  evaluation  to  the  manager  of  the  Utilities  Engineering  Bureau 
for  final  review  and  approval. 

The  alliance  is  rated  on  four  criteria:  quality  of  the  work  and 
deliverables,  adherence  to  project  schedule,  adherence  to  project 
budget,  and  task  management.  The  PUC  rates  the  alliance  using  the 
descriptions  of  poor,  needs  improvement,  meets  requirements, 
exceeds  requirements,  or  excellent.  We  converted  the  descriptions 
to  a numerical  five  point  scale  with  poor  being  equivalent  to  1,  and 
excellent  being  equivalent  to  5. 


RECOMMENDATIONS 

To  ensure  that  the  San  Francisco  Water  Alliance  complies  with  the 
compensation  provisions  of  its  agreement  with  the  Public  Utilities 
Commission,  the  PUC  should  take  the  following  actions: 

• Promptly  inform  the  alliance  of  any  amounts  that  it 
disallows  or  does  not  pay  so  that  the  alliance  can  provide 
the  necessary  documentation  to  support  its  expenses. 

• Require  the  alliance  to  review  the  billing  rates  for  the 
invoices  we  did  not  review  to  identify  any  other  payroll 
errors  made  by  the  alliance  or  its  sub-consultants.  The 
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alliance  should  submit  its  results  to  the  PUC.  The  PUC 
should  also  review  the  results  so  that  it  can  ensure  that  the 
alliance  and  its  sub-consultants  are  billing  the  proper  rate 
for  its  employees  by  verifying  that  the  employees’  hourly 
rates  in  the  invoices  are  the  same  as  the  hourly  rates  the 
employees  are  actually  being  paid,  as  long  as  the  rates  do 
not  exceed  the  amounts  allowed  by  the  agreement.  The 
PUC  should  also  require  the  alliance  to  reduce  future 
invoices  by  the  amounts  that  were  overpaid  as  a result  of 
the  incorrectly  charged  employee  hourly  rates. 

• Ensure  that  the  alliance  is  only  billing  for  the  hours  that  are 
paid  to  non-exempt  employees  by  requiring  that  the 
employees’  pay  registers  and  timesheets  be  submitted  with 
the  invoices  so  that  the  PUC  can  verify  that  the  hours  paid 
match  the  hours  billed. 

• Require  the  alliance  to  submit  original  receipts  that  support 
reimbursement  requests  for  other  direct  charges.  The  PUC 
should  not  approve  any  payments  for  other  direct  charges 
without  the  receipts.  The  PUC  should  also  make  sure  all 
parties  are  in  agreement  as  to  what  constitutes  other  direct 
costs  that  will  be  reimbursed  by  the  PUC.  The  PUC  should 
also  require  the  alliance  to  reduce  future  invoices  by  the 
amounts  that  were  overpaid  as  a result  of  the  incorrectly 
charged  other  direct  costs. 


We  conducted  this  review  according  to  generally  accepted  government  auditing  standards.  We 
limited  our  review  to  those  areas  specified  in  the  audit  scope  section  of  this  report. 


Staff:  Carmen  LeFranc,  Audit  Manager 
Ann  Foley 
Leon  Valle,  Jr. 

Helen  Vo 

cc:  Mayor 

Board  of  Supervisors 
Civil  Grand  Jury 
Budget  Analyst 
Public  Library 
KPMG  LLP 


i 
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APPENDIX 


PUC  Evaluations  of  San  Francisco  Water  Alliance 
Completed  and  Interim  Task  Orders 


Evaluation  Scores* 


Task 

Description 

Completed 

Quality 

Adherence 

Adherence 

Task 

Average 

Invoiced 

Budgeted 

Order 

or 

of 

To  Project 

To  Project 

Manage- 

Evaluation 

Costs  as  of 

Cost  as  of 

Interim 

Work 

Schedule 

Budget 

ment 

Score 

May  31 ,2001 

May  31,  2001 

1 

Interim  Insurance 

C 

3 

3 

3 

4 

3 

$251,198 

$251,198 

2 

Startup  and  Team  Building 

C 

4 

2 

4 

3 

3 

71,668 

95,000 

3 

Program  Management  Office  Tasks 

1 

4 

3 

4 

3 

4 

1,567,083 

2,460,000 

4 

Owner  Controlled  Insurance 
Program  Risk  Assessment 

c 

4 

2 

5 

4 

4 

12,187 

19,460 

5 

Capital  Improvement  Program  10 
Year  Plan 

1 

5 

4 

4 

4 

4 

421,075 

461,500 

6 

Hetch  Hetchy  Project 

1 

5 

3 

3 

4 

4 

155,029 

507,806 

7 

Reliability  Phase  III  Planning 

c 

5 

5 

5 

5 

5 

5,763 

9,500 

8 

Millbrae  Seismic  Upgrade 

c 

3 

3 

3 

3 

3 

1,677 

3,000 

9 

Sunol  Valley  Water  Treatment 
Plant  Improvements  - Phase  1 

c 

3 

3 

4 

3 

3 

17,981 

19,900 

10 

Program  Manager  Support  for 
1995B  Sewer  Bond  Projects 

1 

3 

3 

3 

4 

3 

86,554 

167,600 

11 

Moccasin  Communication 

c 

4 

4 

4 

5 

4 

559 

800 

12 

Priest  Reservoir  Bypass 

c 

3 

3 

4 

3 

3 

2,904 

4,800 

13 

Estimating  for  Sewer  and  Sewer 
Systems  Contracts 

1 

3 

4 

4 

4 

4 

18,197 

49,600 

14 

Solids  Handling  Upgrade 

1 

5 

4 

4 

5 

5 

31,463 

318,294 

15 

Cost  Estimating  Support 

1 

3 

4 

4 

4 

4 

120,388 

132,636 

16 

Reliability  Phase  III  Implementation 

1 

4 

3 

3 

4 

4 

184,482 

754,602 

17 

Supervisory  Control  and  Data 
Acquisition  System  - Assistant 
Project  Manager 

c 

4 

3 

3 

2 

3 

24,830 

151,470 

18 

Crystal  Springs  Bypass  Conduit 

1 

5 

4 

5 

5 

5 

60,997 

67,000 

19 

Health  and  Safety  Construction 
Safety  Plan 

1 

4 

3 

3 

4 

4 

13,867 

39,238 

197,250 

20 

Intertie  Pipeline  and  Pump  Station 

1 

3 

3 

3 

3 

3 

71,752 

21 

Staff  Training 

1 

5 

5 

5 

5 

5 

24,854 

128,625 

22 

Utilities  Engineering  Bureau 
Closeout  Support 

1 

3 

3 

3 

4 

3 

70,546 

90,102 

180,836 

194,794 

23 

Program  Management  Information 
System  Monitoring  and  Control 

1 

3 

3 

3 

3 

3 

24 

Communication  and  Outreach 

1 

4 

4 

3 

4 

4 

92,699 

288,711 

25 

Diversity  Program 

1 

N/A 

N/A 

N/A 

N/A 

N/A 

62,666 

366,936 

26 

Cost  Estimating  Group  Training 

1 

3 

3 

3 

3 

3 

29,733 

120,083 

27 

Phase  1 Improvement 

1 

4 

4 

4 

4 

4 

7,454 

232,602 

28 

Construction  Scheduler 

1 

3 

3 

3 

3 

3 

7,101 

116,301 

29 

Task  Not  Started 

- 

- 

- 

- 

- 

- 

- 

30 

Priest  Bypass 

1 

N/A 

N/A 

N/A 

N/A 

N/A 

36,630 

36,955 

31 

Bayland  Recovery  Project 

1 

4 

4 

4 

5 

4 

28,538 

124,500 

32 

Peninsula  Improvement 

1 

N/A 

N/A 

N/A 

N/A 

N/A 

16,277 

201,712 

Total 

$3,586,254 

$7,702,709 

5=Excellent 

4=Exceeds  Requirements 
3=Meets  Requirements 
2=Needs  Improvement 
1 =Poor 

N/A=Not  Available 
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SAN  FRANCISCO  PUBLIC  UTILITES  COMMISSION 
RESPONSE  TO  THE  AUDIT:  


Water 

hetch  hetchy 
WATER  & POWER 
CLEAN  WATER 


SAN  Francisco  public  Utilities  Commission 

General  Manager’s  Office 

1 155  Market  Sireel,  4'"  Floor  # San  Francisco  California  ® 94103 
415.554.3160  « Fax  415.554.3161 


September  27, 2001 


Willie  L Brown,  Jr. 
Mayor 

Ann  Moller  Caen 
Presinent 

E.  Dennis  Normandy 
Vice  President 
Frarik  L.  Cook 
Ashok  K.  Bhatt 


Edward  Harrington 
Controller 

City  and  County  of  San  Francisco 
City  Hall 

San  Fnincisco,  CA  94103 


Steven  0.  Leonard 
Acting  General  Manager 


Subject:  ITie  San  Francisco  Water  Alliance  (SFWA)  Contract  Audit  Report 

Audit  Number:  01007 


Dear  Mr.  Harrington: 


The  SFPUC  would  like  to  agrtin  thank  Non  Hirasuna,  Canncn  Le  Franc  and  their 
colleagues  for  conductrag  the  second  audit  for  the  SFWA  contract.  The  intent  of  this 
audit  was  to  evaliutte  the  proper  management  of  the  SFWA  costs  and  performance  in 
accordance  widi  the  agreement.  We  agree  with  the  overall  conclusion  by  the  Audit 
team.  We  have  prepared  respon.ses  to  each  of  the  recommendations  provided  by  die 
Controller’s  Office. 

Again,  I appreciate  the  efforts  of  your  office  in  conducting  this  audit  in  a timely  and 
professional  way. 


SL7MQ/JB 


ATTACHMENT:  SFPUC  Response  to  Audit  Report  # 01007 

CC;  M.  Quan 
E.  West 
Jeet  Bajwa 
K.  Read 


SAN  FRANCISCO  PUBUC  UTILITIES  COMMISSION  RESPONSE  TO  SF^'A  AUDIT  # 01007 


The  Alliance  Generally  Complied  with  the  Compensation  Provisions  of  its 
agreement  with  the  PUC 

Coinnieni:  The  PUC  approved  payments  for  other  direct  charges  but  did  not  receive 
sufficient  documentation  from  the  alliance  to  support  the  charges. 

Response: 

The  PUC  has  a procedure  in  place,  which  requires  the  contractor  to  secure  pre-approval 
for  all  ODCs.  Usually,  the  contractor  provides  backup  when  requesting  payment  for  the 
OE>Cs.  In  the  past  some  ODC  back-ups  may  have  been  missed  but  they  are  now  being 
reviewed.  Currently.  ODC  invoices  are  being  reviewed  for  proper  documentation  and 
approval.  Furthermore,  for  the  Year  2 contract  management,  a part-time  accountant  will 
be  assigned  to  this  project. 

The  PUC  Is  Slow  in  Paying  the  Alliance 

Conunent:  According  to  the  agreement,  the  PUC  should  pay  the  alliance  within  30  days 
of  receipt  of  a .satisfactory  invoice.  However,  the  PUC  often  paid  invoices  one  to  three 

weeks  late the  PUC  did  not  promptly  inform  the  alliance  so  that  it  could  correct  the 

disallowances  identified  by  the  PUC. 

Response: 

Tlie  SFW'A  needs  to  improve  the  quality  control  for  invoices  being  submitted.  The  need 
for  improvement  has  been  brought  to  their  attention.  The  SFWA  invoices  are  often 
cumbersome  with  unnecessarj'  attachments,  which  makes  tlte  review  process  longer. 

The  unnecessary  attachments  increase  the  chances  for  errors.  Task  Order  managers  often 
find  errors,  which  requires  either  clarification  or  correction  by  the  SFW.A.  When  errors 
are  detected,  the  processing  of  invoices  lakes  longer  titan  30  days. 

Generally,  labor  charges  are  paid.  However,  unapproved  ODC’s  or  ODC’s  without 
proper  documentation  are  held  back.  Tlte  PUC  has  implemented  a new  procedure  for 
informing  the  SFWA  of  disallowances,  facilitating  the  payment  reconciliation. 
Furthermore,  PUC  is  developing  a management  plan,  which  w'ill  centralize  the  approval 
process  and  will  shorten  the  review  and  payment  period. 

The  .Alliance  Made  Some  Errors  In  Billing  the  PUC  for  Payroll  Costs 

Comment:  The  alliance  and  its  sub-consultants  made  some  payroll  errors Smee 

the  alliance  did  not  include  the  pay  registers  with  the  invoices,  we  could  not  determine  if 
the  alliance  hilled  the  PUC  only  for  those  hours  that  it  paid  to  its  employees. 

Response: 

As  explained  above,  the  PUC  is  in  the  process  of  revising  its  oversight  team  with  the 
addition  of  an  accountant  to  rectify  these  problems.  Furthermore,  the  PUC  will  a.sk  the 
SFWA  to  submit  all  the  required  pay  registers  for  its  sub-consultants,  and  also  to  confonn 
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with  the  California  Labor  law.  The  SFWA  has  reimbursed  the  PUC  for  itie 
overpayments. 


The  Alliance  Did  Not  Always  Submit  Required  Documents  to  Support  Charges  for 
Other  Direct  Co.sts 

Comment:  Because  the  alliance  did  not  always  submit  required  documents  to  support 

charges  for  other  direct  costs,  the  PUC  disallowed —The  PUC  and  the  alliance 

need  to  communicate  with  each  other  and  formalize  exactly  what  is  considered  sufficient 
documentation  to  be  included  as  back-up  to  the  invoices  the  alliance  submits  to  the  PUC- 

According  to  the  alliance 's  business  manager,  the  alliance  is  seeking  blanket 

approval  for  recurrmg  costs  such  as  messenger  sendees.  According  to  her,  the  alliance 
would  obtain  approval  before  wcuning  non-recurring  costs. 

Response: 

As  recommended^  the  PUC  will  have  a meeting  with  the  SFWA  to  set  the  rules  and 
procedure  for  ODC  approval.  The  procedure  for  pre-approval  of  ODCs  is  in  place  and 
PUC  staff  will  ensure  that  these  procedures  are  followed.  The  SFWA  will  submit  ODC’s 
for  pre-approval  for  a Task  Order  with  a cost  estimate.  Additional  clarifications  of  this 
procedure  will  be  developed  and  implemented  shoitly. 

RECOMMENDATIONS 

• Promptly  infonn  the  alliance  of  any  amounts  that  it  disallows  or  does  not  pay  so 
that  the  alliance  can  provide  the  necessary  documentation  to  support  its  expenses. 

Response:  The  PUC  notifies  the  SFWA  when  diere  are  disallowed  amounts  on 
the  invoices  with  exphinalions  of  the  disallowance. 

• Require  the  alliance  to  review  the  billing  rates  for  the  invoices The  PUC 

should  also  require  the  alliance  to  reduce future  invoices  by  the  amounts  that 
were  overpaid  as  a result  of  the  incorrectly  charged  employee  hourly  rates. 

Response:  The  PUC  will  request  the  SFWA  to  make  these  corrections  promptly 
and  to  reimburse  the  City  for  all  overpaid  amounts.  Previous  overpayments  have 
been  reimbursed  to  die  PUC. 

• Ensure  that  the  alliance  is  only  hilling  for  the  hours  that  are  paid  to  employees  by 

requiring  the  pay  registers  and the  PUC  can  verify  that  the  hours  paid 

match  the  hours  billed. 

Response:  Tlie  PUC  will  request  the  SFWA  to  submit  all  the  pay  registers  for 
employees  requiring  them. 


SAN  FRANCISCO  PUBLIC  LTILITIES  COMMISSION  RESPONSE  TO  SFWA  AUDIT  #01007 


Require  the  allimce  to  submit  original  receipts The  PUC  should  also  require 

the  allUince  to  reduce  future  invoices  by  the  atnounts  that  were  overpaid  as  a 
result  of  the  incorrectly  charged  other  direct  costs. 

Response:  The  PUC  will  request  the  SFWA  to  submit  the  original  receipts  per  the 
agreement  and  to  improve  quality  control  of  its  invoices.  The  SFWA  has 
reimbursed  the  PUC  for  overpayments. 


SAN  FRANCISCO  WATER  ALLIANCE 
RESPONSE  TO  THE  AUDITj 


San 

Francisco 
Water 
Alliance 

Bedilcl  inlnistnidure  Corponition 
The  Jellenon  Componr 
Sverdrup  Civil,  Inc 

October  1,2001 

Mr.  Edward  Harrington  - Controller 
City  & County  of  San  Francisco 
1 Dr.  Carlton  B.  Goodlett  Place 
San  Francisco,  CA  94102-4694 

In  reply,  please  refer  to:  CCN  00997 

Subject:  Response  to  the  Second  Audit  of  the  SFWA  Program  Management  Contract 

Dear  Mr.  Harrington: 

We  would  like  to  thank  you  and  your  staff  including  Carmen  LeFranc,  Helen  Vo,  and  Leon  Valle,  for  this 
second  review  of  the  Performance  of  Professional  Services  Agreement  with  the  SFWA  this  year.  We 
have  continued  to  make  changes  to  our  invoicing,  billing  and  other  areas  mentioned  in  your  first  report 
and  hope  to  address  ail  of  your  recommendations  as  soon  as  we  can.  As  you  noted  in  your  report  this 
second  audit  started  immediately  after  the  first  audit  was  completed,  and  we  did  not  have  sufficient  time 
to  correct  many  of  the  prior  audit’s  findings,  some  of  which  will  need  modifications  to  the  current  PMC 
contract. 

In  your  assessment  you  note  once  again  that  the  findings  are  minor,  that  our  timesheets  are  in  order  and 
that  we  have  generally  complied  with  the  compensation  provisions  of  our  agreement  with  the  PUC.  You 
have  also  concluded  that  we  continue  to  complete  tasks  in  a satisfactory  manner  using  the  performance 
evaluation  given  in  your  Appendix  A,  which  indicates  that  against  a benchmark  of  4.0,  which  is  ‘Exceeds 
Requirements’,  the  Alliances’  average  overall  performance  is  3.7. 

We  have  credited  the  PUC  fully  on  all  overcharges  mistakenly  billed  previously  and  hope  to  receive  the 
amounts  owed  to  us  by  the  PUC  soon.  We  are  pleased  to  note  that  the  documentation  and  receipts  that 
we  provided  you  to  support  other  direct  charges  met  your  requirements  fully,  and  you  consider  it  to  be 
complete.  We  will  in  the  future  endeavor  to  submit  full  and  complete  documentation  to  the  PUC  as  well. 

Should  you  have  any  questions  please  do  not  hesitate  to  contact  me  on  41 5-554-7678  or  Ann  Saha  on 
415-554-7680. 


Regards, 


Dr)  John  W.  Kluesener 
Program  Director 
plan  Francisco  Water  Alliance 
875  Stevenson  Street,  Floor 
San  Francisco,  CA  94103 
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Audit  Finding:  The  PUC  Is  Slow  in  Paying  the  Alliance 


SFWA  response:  We  continue  to  emphasize  that  we  should  be  notified  of  delays 
and  receive  specific  explanations  promptly,  perhaps  from  a single  point  of 
contact  within  the  PUC,  for  non-payment  of  invoices.  Our  minority  sub 
consultants  are  small  business  owners  and  cannot  meet  their  payroll  if  they  in 
turn  are  not  paid  per  terms  of  the  contract,  and  in  a timely  manner. 

Audit  Finding:  The  Alliance  Made  Some  Errors  In  Billing  the  PUC  for  Payroll  Costs 

SFWA  Response:  The  following  is  a summary  of  the  over  and  under  billings 
identified  in  your  report.  We  have  totally  credited  the  PUC  as  of  September  2001 
for  all  amounts  due. 


> Over-billing 

> Under-billing 

> Total  over-billing 

> Total  credits 
Given  to  the  PUC 

> Balance  owed  PUC 


$5,444.84 

($1.271.12) 

$4,173.72 

($4.173.72) 

$0 


Audit  Finding:  The  Alliance  did  not  Always  Submit  Required  Documents  to  Support 
Charges  for  Other  Direct  Costs.  Audit  statement  first  paraaraph  . . the  PUC 
disallowed  $27,724  of  the  $139,245  in  other  direct  costs  the  Alliance  requested  for 
reimbursement. ...” 


SFWA  response:  Of  the  $27,724  the  PUC  has  paid  $8,900.  The  Alliance  is 
working  with  the  PUC  to  submit  additional  documentation  to  support  the  unpaid 
balance  in  the  invoices 

Audit  statement  second  paraaraph:  "...  the  Alliance  provided  the  PUC  with  a nine  page 
detailed  breakdown  for  $881  in  telephone  charges  in  Alliance’s  invoices  for  April  2001. 
However  the  Alliance  did  not  specifically  identify  the  amounts  that  the  Alliance 
requested  for  reimbursement.  Instead,  the  Alliance  simply  requested  that  a lump  sum 
of  $643  be  reimbursed. . ..  ” 

SFWA  Response:  We  have  subsequently  itemized  the  expenses  that  total  to  the 
$643  amount  and  have  corrected  our  procedure  in  this  area.  All  future  invoices 
specifically  identify  the  applicable  charges  and  the  total  being  requested  for 
reimbursement. 
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Audit  statement  second  Daraaraph:  "...  In  some  instances,  the  Alliance  also  submitted 
irrelevant  documentation  that  did  not  specifically  support  the  request  for 
reimbursement  for  some  other  direct  charges.  /As  a result,  the  PUC  staff  could  not 
reconcile  what  was  invoiced  by  the  Alliance  to  the  support  included  with  the  invoices. 
It  also  caused  the  PUC  to  not  reimburse  the  Alliance  for  those  charges. 

SFWA  Response:  As  noted  in  the  controller’s  report,  the  Alliance  subsequently 
submitted  ALL  relevant  and  complete  documentation  supporting  the  other  direct 
charges  to  the  Controller  and  in  the  future  will  submit  the  same  to  the  PUC 

Audit  statement  third/fourth/fifth  paragraph:  “ In  another  Instance,  the  Alliance 

submitted  over  forty  pages  of  copies  of  receipts  for  one  of  its  employee’s  traveling 
expenses  that  included  unallowable  expenses  even  though  it  was  requesting 
reimbursement  for  per  diem  costs  that  did  not  include  those  unallowable  expenses. 

SFWA  Response:  The  Alliance  billed  the  employee’s  expense  following  FAR 
guidelines  on  per  diem  rates  in  San  Francisco  for  Hotel  and  lodging  and  meals 
and  other  incidental  expenses.  All  of  the  expenses  were  within  the  FAR 
allowances  per  day.  It  is  unfortunate  that  the  additional  information  hindered 
rather  than  helped  the  PUC  in  analyzing  the  invoice.  In  the  future  the  Alliance 
will  not  submit  any  backup  with  expenses  that  are  being  invoiced  at  a per  diem 
rate 

The  Alliance  mistakenly  credited  the  PUC  for  $7,564,  prior  to  even  receiving 
payment  for  the  amount.  The  PUC  owes  the  Alliance  approximately  $7,000  at 
this  time.  The  Alliance  will  resubmit  the  employee’s  expense  with  the  next 
month’s  invoice.  The  $230  over  billing  due  to  conversion  rates  between  the 
British  pound  sterling  and  the  dollar  will  be  fully  credited  in  next  month’s  billing 

Audit  statement  sixth  paragraph:  “ We  also  found  that  the  PUC  approved 

reimbursement  of  some  other  direct  charges  without  adequate  support.  The  Alliance 
did  not  submit  receipts  to  support  $13,995  in  other  direct  charges.  Instead  of 
submitting  receipts  to  support  the  charges,  the  Alliance  instead  submitted  a detailed 
schedule  of  the  charges.  We  also  noted  that  the  PUC  approved  for  payment  $8, 730  of 
the  unsupported  other  direct  charges.  The  PUC  should  not  approve  paying  for  any 
other  direct  charges  without  original  receipts  from  the  Alliance” 

SFWA  Response:  As  noted  in  the  Controller’s  second  audit  report  we  provided 
receipts  for  the  entire  amount  to  the  Controller’s  satisfaction. 
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Audit  statement  seventh  paragraph:  The  Alliance  also  submitted  reimbursement 
requests  for  other  direct  costs  that  are  not  specifically  allowed  in  the  agreement.  It 
requested  reimbursement  for  $70  in  Muni  fast  passes  and  for  training  costs  of  $120.  In 
addition  the  Alliance  billed  the  PUC  for  outside  services  for  $236  and  communication 
costs  for  $61  that  are  not  chargeable  to  the  PUC.  According  to  the  Alliance’s  business 
manager,  the  Alliance  will  credit  the  PUC  for  these  costs  on  its  next  invoice.  Because 
the  PUC  also  erroneously  underpaid  the  Alliance  for  one  of  the  Alliance  invoices  for 
$50,  the  Alliance  needs  only  to  credit  the  PUC  for  $437 

SFWA  Response:  The  Alliance  subsequently  corrected  its  August  2001  invoices 
to  take  into  account  the  errors  we  identified.  The  June-July  ‘01  Other  Direct  Cost 
invoice  will  include  a credit  to  the  PUC  for  $436.73.  Also  as  we  mentioned  earlier 
the  findings  regarding  the  allowance  of  the  MUNI  fast  pass  and  other  items  will 
need  a modification  to  the  contract.  This  matter  is  pending. 

Audit  Statement:  According  to  Appendix  D of  the  agreement,  direct  labor  charges  are 
limited  to  actual  salaries  of  employees.  Although  the  sub-consultant  allowed  the 
employee,  who  billed  eighty-four  hours  in  a two  week  time  period,  to  earn 
compensatory  time  off  for  the  four  excess  hours  worked  and  charged  to  the  PUC, 
there  is  no  agreement  between  the  Alliance  and  the  PUC  regarding  compensatory 
time.  In  addition,  the  sub-consultant’s  employee  handbook  states  that  compensatory 
time  is  capped  at  a maximum  amount  of  80  hours  and  that  compensation  will  not  be 
paid  for  any  unused  accumulated  compensatory  time. 

SFWA  response:  The  Alliance  has  corrected  the  charging  practices  of  its  exempt 
employees  so  that  no  exempt  employees  charge  more  than  8 hours  a day.  Non- 
exempt employees  will  continue  to  charge  over  8 hours  a day  if  required  and 
approved  by  the  PUC  in  advance.  Overtime  will  be  paid  as  allowed  by  standard 
charging  practices  for  non-exempt  employees 
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CITY  AND  COUNTY  OF  SAN  FRANCISCO 


OFFICE  OF  THE  CONTROLLER 
AUDITS  DIVISION 


Edward  Harrington 
Controller 

Matthew  H.  Hymel 
Chief  Assistant  Controller 


October  4,  2001 

Terry  Gwiazdowski,  Program  Director 
San  Francisco  Public  Library 
100  Larkin  Street 
San  Francisco,  CA  94102 

Dear  Ms.  Gwiazdowski: 

Enclosed  is  our  report  concerning  the  second  review  of  the  agreement  the  San  Francisco 
Public  Utilities  Commission  (PUC)  has  with  the  San  Francisco  Water  Alliance  (alliance)  to 
procure  program  management  and  construction  management  services  in  support  of  the 
PUC’s  water,  power,  and  sewer  capital  improvement  program.  The  report  indicates  that  the 
alliance  generally  complied  with  the  compensation  provisions  of  its  agreement  with  the 
PUC. 


Sincerely, 


NORIAKI HIRASUNA 
Director 


Enclosure 


documents  dept 
OCT  1 0 2C::1 

SAN  FRANCISCO 
PUBLIC  LIBRARY 


City  Hall  • 1 Dr.  Carlton  B.  Goodlett  Place  • Room  388  • San  Francisco  CA  94102-4694 
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PUBLIC  UTILITIES 
COMMISSION: 

The  Third  Review  of  Its 
Professional  Services 
Agreement  With  the 
San  Francisco  Water  Alliance 


DOCUMENTS  DEPT. 

APR  1 1 2SC2 
SAN  FRANCISCO 


Audit  Number  01061 
April  8,  2002 


CITY  AND  COUNTY  OF  SAN  FRANCISCO 


OFFICE  OF  THE  CONTROLLER 


Edward  Harrington 
Controller 


April  8,  2002 


Audit  Number  01061 


Public  Utilities  Commission 
1155  Market  Street,  4^^^  Floor 
San  Francisco,  CA  94103 

President  and  Members: 

The  Controller’s  Audits  Division  (division)  presents  its  report  on  the  division’s  review  of 
the  agreement  between  the  Public  Utilities  Commission  (PUC)  of  the  City  and  County  of 
San  Francisco  and  the  San  Francisco  Water  Alliance  (alliance)  to  provide  program 
management  and  construction  management  services  that  support  the  PUC’s  water,  power, 
and  sewer  capital  improvement  program.  This  audit  is  the  third  in  a series  of  audits  that  the 
Office  of  the  Controller  is  conducting  on  fulfillment  of  the  agreement  between  the  PUC 
and  the  alliance. 

During  this  third  audit,  according  to  evaluations  completed  by  PUC  project  managers,  the 
PUC  finds  that  the  alliance  is  performing  satisfactory  work.  We  found  that  the  alliance 
generally  comphed  with  the  compensation  provisions  of  its  agreement  with  the  PUC.  We 
examined  a sample  of  invoices  submitted  by  the  alliance  and  reviewed  by  the  PUC  as  of 
February  22,  2002.  The  PUC  reviewed  invoices  submitted  through  December  31,  2001,  for 
services  rendered  for  June  2001  through  November  2001.  Although  the  alliance  generally 
adhered  to  the  agreement’s  requirements  when  it  submitted  invoices  accompanied  by 
documents  to  support  most  of  its  charges,  the  alliance  and  its  subconsultants  made  minor 
errors  in  billing  the  PUC.  Furthermore,  the  alliance  did  not  obtain  prior  approval  for 
incurring  other  direct  charges  and  the  PUC  has  not  yet  approved  payments  for  these  other 
direct  charges. 

The  PUC’s  and  alliance’s  responses  are  attached  to  the  report.  The  division  will  be 
working  with  the  PUC  and  the  alliance  to  follow  up  on  the  status  of  the  recommendations 
made  in  this  report. 

Respectfully  submitted. 


■Edward  Harringtoi 
Controller 
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SUMMARY 


Audit  Highlights. . . 

Our  audit  of  the  San 

Francisco  Water  Alliance 

revealed  the  following: 

El  The  PUC  finds  that  the 
alliance  satisfactorily 
completed  most  task 
orders. 

El  The  alliance  met  most 
short-term  performance 
measures,  however, 
long-term  performance 
measures  are  not  yet 
applicable. 

El  The  alliance  generally 
complied  with  payment 
provisions  but  made 
minor  errors  in  billing 
the  PUC. 

El  The  alliance  did  not 
obtain  prior  approval 
for  incurring  other 
direct  charges. 

El  The  PUC  has  not 

approved  payments  for 
other  direct  charges. 

El  Bechtel  performed  a 
review  rather  than  an 
audit  of  the  consultant 
members’  overhead 
costs. 


RESULTS  IN  BRIEF 

The  San  Francisco  Water  Alliance  (alliance)  generally 
fulfilled  the  compensation  provisions  of  its  professional 
services  agreement  (agreement)  with  the  Public  Utilities 
Commission  (PUC)  of  the  City  and  County  of  San  Francisco.  The 
agreement  directs  the  alliance  to  provide  program  management  and 
construction  management  services  that  support  the  PUC’s  water, 
power,  and  sewer  capital  improvement  program. 

The  PUC  staff  members  who  manage  and  evaluate  the  projects  that 
the  alliance  completes,  continue  to  state  that  the  alliance  is 
performing  work  that  is  satisfactory  or  better  for  most  project  task 
orders.  The  PUC  found  that  the  alliance  completed  all  but  one  of 
the  task  orders  at  least  satisfactorily,  rating  performance  on  19  out 
of  the  40  task  orders  started  in  the  first  year  of  the  agreement  as 
either  excellent  or  exceeds  requirements.  For  evaluations  rating  the 
remaining  21  task  orders,  only  one  evaluation  showed  an  average 
of  criteria  scores  that  fell  below  meets  requirements.  Although  the 
PUC  found  that  all  of  the  alliance’s  work  related  to  engineering 
was  at  least  satisfactory,  three  tasks  received  evaluation  scores  of 
poor  or  needs  improvement  in  the  “quality  of  work”  category. 
These  tasks  involved  the  program  management  information 
system,  the  communication  and  outreach  program,  and  the 
diversity  program.  These  are  discussed  in  detail  in  the  report. 

An  independent  peer  review  panel  assessed  the  short-term  and 
long-term  performance  measures  required  by  the  agreement.  The 
panel  found  that  the  alliance  substantially  met  short-term 
performance  measures  for  the  first  year  of  the  agreement. 

However,  the  long-term  performance  measures  are  not  yet 
applicable.  The  panel  believes  that  the  long-term  measures  require 
a more  fundamental  revision,  such  as  adopting  a mission 
statement.  The  panel  also  believes  that  performance  measures 
should  be  established  within  each  task  order  to  eliminate  the 
“disconnect”  currently  occurring  between  the  task  orders  issued 
and  the  previously  defined  performance  measures.  However, 
because  it  appears  that  the  agreement  will  not  be  extended  for 
another  year,  the  PUC  did  not  revise  the  measures,  but  instead 
established  deliverables  and  due  dates  for  the  task  orders  started  in 
the  second  year  of  the  agreement. 
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We  reviewed  the  payroll  and  overhead  costs  included  in  a sample 
of  invoices  submitted  by  the  alliance  and  reviewed  and  paid  by  the 
PUC  as  of  February  22,  2001 . As  of  this  date,  the  PUC  completed 
its  review  of  invoices  that  the  alliance  had  submitted  through 
December  31,  2001,  for  services  rendered  from  June  2001  through 
November  2001.  The  charges  on  these  invoices  totaled  $3,746,374, 
and  the  charges  on  the  invoices  included  in  our  sample  totaled 
$1,804,871. 

Although  the  alliance  generally  complied  with  the  agreement  when 
submitting  its  invoices  and  the  records  and  documents  that  support 
its  charges,  the  alliance  and  its  subconsultants  made  minor  errors 
in  billing  the  PUC.  Specifically,  for  the  sample  of  employee 
salaries  that  we  reviewed,  the  alliance  underbilled  the  PUC  $629 
for  one  employee  and  overbilled  the  PUC  $8,359  for  several  other 
employees.  The  net  result  of  these  errors  is  that  the  alliance 
overbilled  the  PUC  $7,730  for  the  invoices  that  we  reviewed.  This 
was  the  only  significant  billing  error  that  we  identified  out  of  the 
$1.8  million  of  invoices  that  we  reviewed. 

When  reviewing  all  the  other  direct  charges  that  the  alliance 
requested  for  reimbursement,  we  found  that  the  alliance  did  not 
obtain  prior  approval  to  incur  these  other  direct  charges. 
Furthermore,  the  PUC  has  not  yet  approved  payments  for  the  other 
direct  charges  that  the  alliance  has  charged  the  PUC. 

Finally,  Bechtel  Infrastructure  Corporation  (Bechtel),  at  its  ovm 
cost,  completed  a review  of  the  overhead  costs  for  one  prime 
consultant  and  all  of  the  alliance’s  subconsultants  that  were 
identified  in  the  agreement.  Before  the  end  of  the  agreement’s  first 
year,  Bechtel  was  to  coordinate  with  consultant  members  to 
produce  an  audit  of  the  overhead  costs  and  resulting  rates  for  each 
consultant  member,  performed  in  accordance  with  the  standards  of 
the  Code  of  Federal  Regulations.  We  noted  that  while  Bechtel’s 
internal  audit  department  performed  a review  rather  than  an  audit, 
the  review  procedures  appear  adequate.  However,  we  believe  that 
two  of  the  alliance  members  require  further  review  because  their 
overhead  rates  exceeded  the  agreement’s  ceiling  rate. 
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INTRODUCTION 


BACKGROUND 

The  Public  Utilities  Commission  (PUC)  of  the  City  and 

County  of  San  Francisco  (City)  has  a professional  services 
agreement  (agreement)  with  the  San  Francisco  Water 
Alliance  (alliance),  a joint  venture  of  Bechtel  Infrastructure 
Corporation  (Bechtel),  The  Jefferson  Company,  and  Sverdrup 
Civil,  Inc.  Under  the  agreement,  the  alliance  provides  program 
management  and  construction  management  services  that  support 
the  PUC’s  water,  power,  and  sewer  capital  improvement  program. 
The  agreement  requires  the  alliance  to  provide  overall  direction 
and  guidance  to  the  program,  to  supply  project  and  construction 
management  services  to  individual  projects  to  furnish  technical 
support  services  primarily  in  defining  engineering  needs, 
optimizing  the  selection  of  design  alternatives,  and  providing 
technical  expertise  to  manage  workload  peaks. 

Approved  by  the  Board  of  Supervisors  (board)  on  September  8, 
2000,  the  agreement  has  a four-year  term.  Unless  the  City’s  Office 
of  the  Controller  (controller)  certifies  first  the  availability  of  funds 
for  each  specific  task  identified  by  the  PUC,  the  alliance  cannot 
furnish  any  services  and  cannot  receive  payment  for  any  work.  In 
addition,  the  PUC  and  the  alliance  cannot  extend  the  term  of  the 
agreement  unless  the  City’s  Civil  Service  Commission  and  the 
board  approve  a modification.  The  board  is  to  approve  aimually  the 
continuation  of  the  agreement  for  another  year,  and  the  controller 
is  to  certify  the  availability  of  funds  for  that  year.  If  the  board 
disapproves  a subsequent  annual  phase  of  the  agreement,  the 
agreement  ends  without  the  City  incurring  any  liability  to  the 
alliance. 

The  agreement  further  states  that  if  the  board  does  not  end  the 
agreement,  and  if  the  board’s  inaction  is  not  the  result  of  the 
PUC’s  untimely  submission  of  reports  to  the  board,  the  agreement 
shall  continue.  However,  if  the  City’s  board  does  not  appropriate 
funds  to  the  alliance  for  the  next  succeeding  fiscal  year,  or  if  it 
appropriates  funds  for  only  a portion  of  a fiscal  year,  the  agreement 
will  terminate  without  penalty,  liability,  or  expense  of  any  kind  to 
the  City  at  the  end  of  the  term  for  which  the  board  appropriated  the 
funds. 
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The  PUC  is  to  pay  the  alliance  within  30  days  after  the  alliance  has 
presented  a satisfactory  invoice  for  work  it  performed  during  a 
specified  month.  The  total  amount  paid  under  the  agreement  is  not 
to  exceed  $45  million.  The  agreement  includes  a provision  for  the 
PUC  to  pay  the  alliance  a fee  in  addition  to  the  reimbursement  of 
direct  salaries  and  overhead.  The  provision  adds  fixed  and 
performance  elements  to  the  fee’s  calculation.  During  the  first  year 
of  the  agreement,  the  fee  is  fixed  at  8 percent.  Beginning  in  the 
second  year,  the  fixed  fee  drops  to  7 percent,  and  the  agreement 
adds  to  the  base  fee  a semiannual  performance  fee  between  0 and 
4.5  percent.  The  PUC  is  to  pay  this  semiannual  fee  based  on  the 
alliance’s  performance  according  to  benchmarks  that  both  parties 
agree  upon  during  the  first  review  after  the  first  1 8 months  of  the 
agreement.  Furthermore,  the  PUC  is  not  to  make  any  payments 
until  the  alliance  provides  the  PUC  with  the  reports  or  services 
required  under  the  agreement. 

The  agreement  requires  the  PUC,  through  the  controller,  to 
conduct,  at  least  semiannually,  an  audit  that  evaluates  whether  the 
alliance’s  costs  and  performance  meet  the  agreement’s 
specifications.  This  report  is  the  third  in  a series  of  audits  that  the 
controller  is  conducting  on  the  fulfillment  of  the  PUC’s  and  the 
alliance’s  agreement. 


SCOPE  AND  METHODOLOGY 

The  purpose  of  this  audit  was  to  determine  whether  the  alliance 
complied  with  the  agreement,  particularly  those  applying  to  the 
provisions  of  performance  and  compensation.  Therefore,  we 
reviewed  the  terms  of  the  agreement  between  the  alliance  and  the 
PUC,  assessed  the  alliance’s  procedures  for  billing  the  PUC,  and 
evaluated  the  PUC’s  procedures  for  paying  the  alliance. 

To  analyze  billings  and  payments  related  to  the  agreement,  we 
selected  a sample  of  invoices  submitted  by  the  alliance  and 
reviewed  by  the  PUC  as  of  February  22,  2002.  As  of  this  date,  the 
PUC  reviewed  invoices  submitted  by  the  alliance  through 
December  31,  2001,  for  services  rendered  from  June  2001  through 
November  2001.  We  examined  a sample  of  invoices  to  determine 
whether  the  requests  for  payment  had  proper  support  and  did  not 
exceed  budgeted  amounts.  To  determine  whether  the  labor  rates 
that  the  alliance  billed  to  the  PUC  met  the  agreement’s 
requirements,  we  assessed  a sample  of  payroll  costs.  Further,  we 
reviewed  all  other  direct  charges  listed  on  the  invoices  to 
determine  whether  the  agreement  allowed  those  charges. 
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In  addition  to  examining  invoices,  we  conducted  interviews  and 
analyzed  evaluations  related  to  the  agreement.  Specifically,  we 
interviewed  nine  task  order  project  managers,  the  Capital 
Improvement  Program  (CEP)  manager,  and  the  Utilities 
Engineering  Bureau  director,  about  the  alliance’s  performance 
under  the  agreement.  We  also  reviewed  the  evaluations  prepared 
by  the  PUC  for  the  task  orders  completed  by  the  alliance.  We  did 
not  evaluate  the  work  products  that  resulted  from  the  individual 
task  orders  because  we  do  not  possess  the  necessary  technical 
expertise.  Instead  we  relied  upon  the  expertise  of  the  PUC  staff  to 
issue  accurate  evaluations  of  the  alliance’s  performance. 

Finally,  we  examined  the  August  2001  review  report  that  Bechtel 
issued  after  it  reviewed  the  overhead  costs  and  resulting  rates  that 
the  alliance’s  subconsultants  charged  to  the  PUC.  We  reviewed  the 
workpapers  and  a copy  of  its  internal  audit  department’s  charter  to 
determine  whether  the  work  done  generally  supports  the 
summaries  and  recommendations  in  the  review  report  and  whether 
the  internal  audit  department  is  an  independent  organization  within 
Bechtel.  We  determined  that  the  review  procedures  appear 
adequate  and  that  they  properly  support  the  report’s  information. 
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AUDIT  RESULTS 


THE  SERVICES  SUPPLIED  BY 
THE  SAN  FRANCISCO  WATER  ALLIANCE  ARE 
MOSTLY  SATISFACTORY,  BUT  SOME  OF  ITS 
MANAGEMENT  AND  ADMINISTRATIVE 
PRACTICES  NEED  REVISION 

Since  our  audit  report  dated  October  2,  2001,  when  we  last 
reviewed  the  San  Francisco  Water  Alliance  (alliance),  the 
Public  Utilities  Commission  (PUC)  has  continued  to  find 
that  the  alliance  performs  satisfactory  work,  with  exceptions  in 
three  areas:  the  program  management  information  system,  the 
communication  and  outreach  program,  and  the  diversity  program. 
Each  of  these  areas  involves  services  unrelated  to  engineering 
tasks.  Nevertheless,  the  alliance  needs  to  improve  some  of  its 
compensation  and  administrative  practices  so  that  payments  are  not 
delayed  due  to  lack  of  pre-approvals. 


San  Francisco’s  Public  Utilities  Commission  Found  That 
the  Alliance’s  Work  Is  Generally  Satisfactory 

When  we  reviewed  54  evaluations  of  task  and  subtask  orders,  we 
learned  that  the  PUC  usually  rated  the  alliance’s  work  as  “meets 
requirements”  or  better.  Twenty-four  project  managers  for  task 
orders  - specific  projects  that  the  alliance  is  to  complete  under  the 
agreement  - prepared  the  evaluations,  rating  the  alliance  as  to 
whether  the  alliance,  on  average,  met  or  exceeded  requirements  for 
the  tasks  that  it  and  its  subconsultants  undertook.  The  evaluation 
scores  for  the  tasks  appear  in  appendices  A and  B. 


Background 

The  PUC’s  task  order  project  managers  (project  managers),  many 
of  whom  are  PUC  engineers,  write  final  evaluations  when  the 
alliance  completes  each  task  and  the  project  managers  also 
complete  interim  evaluations  for  long-term  projects.  The  project 
managers  are  usually  the  PUC  employees  who  requested  the  tasks 
for  a specific  project  and  who  work  with  alliance  staff  to  ensure 
that  the  staff  completes  the  tasks  to  the  PUC’s  satisfaction.  After 
the  project  manager  completes  the  evaluation,  the  evaluation  first 
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goes  for  review  and  approval  to  the  representative  from  the  PUC’s 
project  management  division.  This  representative,  usually  the 
program  manager  for  the  alliance  agreement,  then  forwards  the 
evaluation  to  the  manager  of  the  PUC’s  Utilities  Engineering 
Bureau  for  final  review  and  approval. 

For  the  40  task  orders  begun  in  the  first  year  of  the  agreement,  the 
PUC  rated  the  alliance  according  to  four  criteria: 

• Quality  of  the  work  and  deliverables 

• Adherence  to  project  schedules 

• Adherence  to  project  budgets 

• Task  management 

For  each  criterion  for  each  task  order,  the  PUC  rated  the  alliance’s 
performance  as  poor,  needs  improvement,  meets  requirements, 
exceeds  requirements,  or  excellent.  We  converted  the  descriptions 
to  a five-point  scale  with  poor  equaling  a score  of  1 , and  excellent 
equaling  a score  of  5. 

For  tasks  begun  in  the  second  year  of  the  agreement,  the  PUC 
changed  the  way  that  it  prepared  and  evaluated  the  task  orders.  The 
PUC  added  performance  measures  to  each  of  the  tasks  and  some 
subtasks  so  that  it  could  better  evaluate  whether  the  alliance  will  be 
entitled  to  the  0 to  4.5  percent  performance  fee  that  the  alliance  can 
charge  if  it  meets  certain  predetermined  milestones  for 
performance.  The  evaluations  for  the  tasks  begun  in  the  second 
year  list  weighted  criteria  that  the  PUC  multiplies  by  a number 
score  tied  to  the  following  definitions:  delivered  as  agreed  (3 
points);  partially  fulfilled  (1.1  to  2.9  points);  and  not  delivered  as 
agreed  (1  point). 

Although  one  goal  of  changing  the  evaluations  was  to  allow  the 
PUC  to  determine  whether  the  alliance  was  entitled  to  a 
performance  fee,  the  scoring  process  was  not  consistent  among 
project  managers.  Discrepancies  in  scoring  lead  to  disagreements 
with  the  alliance  as  to  whether  a performance  fee  percentage  is 
fair.  According  to  the  program  manager,  the  PUC  expects  the 
project  managers  to  use  their  own  judgment  when  preparing  the 
evaluations. 


The  Alliance  Successfully 
Completed  Many  Tasks 


The  alliance  completed 
all  but  one  task  order 
satisfactorily. 


The  PUC  found  that  the  alliance  completed  all  but  one  of  the  task 
orders  at  least  satisfactorily,  rating  performance  on  19  out  of  the  40 
task  orders  as  either  excellent  or  exceeds  requirements.  For 
evaluations  rating  the  remaining  21  tasks,  only  one  evaluation 
showed  an  average  of  criteria  scores  that  fell  below  meets 
requirements,  although  some  task  orders  received  low  scores  on 
individual  criteria.  In  general,  the  PUC  found  that  the  alliance 
completed  successfully  those  tasks  that  involved  some  aspect  of 
engineering. 


The  Capital  Improvement  Program 

The  PUC  considered  a success  the  Capital  Improvement  Program 
(CLP)  tasks  completed  by  the  alliance.  The  PUC  task  manager 
rated  the  alliance’s  quality  of  work  and  deliverables  as  exceeds 
requirements  for  development  of  the  CIP  10-year  plan,  task  order 
5.  The  alliance  also  received  a rating  of  excellent  for  the  CIP  2000 
Update,  task  order  33.  The  PUC  project  manager  wrote  on  the  task 
order  evaluations  that  the  alliance  added  critical  expertise  to  the 
CIP  project  and  produced  high-quality  results  in  a timely  manner. 

According  to  the  PUC  task  order  project  manager,  alliance 
employees  should  work  directly  for,  and  report  to,  responsible 
PUC  staff  This  project  manager  supervised  the  CIP  project  so  that 
both  PUC  staff  and  alliance  staff  reported  directly  to  him.  Unlike 
other  project  managers  we  interviewed,  he  believed  that  he  had 
authority  to  direct  staff  to  complete  the  task.  He  also  told  us  that 
the  agreement  with  the  alliance  should  continue  but  that  it  should 
be  restructured. 


The  Chloramine  Conversion  Project 

Another  success  was  the  Chloramine  Conversion  project,  task 
order  6.  For  the  subtask  that  the  assigned  alliance  engineer  had 
completed  for  the  project,  the  PUC  project  manager  rated  the 
quality  of  work  and  deliverables  as  excellent.  The  PUC  project 
manager  told  us  that  some  aspects  of  task  order  6 did  not  go  well 
initially;  however,  the  alliance  engineer’s  work  benefited  the 
project  significantly.  The  project  manager  said  that  one  of  the 
alliance  employee’s  overarching  tasks  was  to  implement  program 
management  controls  that  the  engineering  section  of  the  PUC  did 
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not  yet  use.  The  evaluation  states  that  the  assistant  project  engineer 
served  as  a reliable  liaison,  facilitated  communication,  and 
spearheaded  efforts  to  complete  an  independent  cost  review  of  the 
project. 


Reliability  Program  Phase  III  and  the  Peninsula 
Improvement  Project 

Fulfillment  of  two  more  task  orders  that  the  PUC  rated  as  excellent 
in  the  area  of  quality  of  work  and  deliverables  involved  the 
Reliability  Program  Phase  III,  task  order  16,  and  the  Peninsula 
Improvement  Project,  task  order  32.  The  PUC  project  manager 
states  in  the  evaluation  of  task  order  16  that  the  technical  work 
products,  project  management  services,  and  overall  support  have 
been  excellent.  Likewise,  the  evaluation  of  task  order  32  states  that 
the  project  team  provided  practical  and  valuable  expertise  on  time 
and  within  the  budget. 


Design  of  PUC  Staff  Training 

Finally,  another  project  that  received  high  ratings  involved  staff 
training,  task  order  21 . A PUC  project  manager  and  one  alliance 
employee  were  the  principal  staff  members  assigned  to  task  order 
21,  with  occasional  work  by  other  alliance  staff.  The  task  order 
directed  alliance  staff  to  create  training  courses  tailored  to  meet 
PUC  employees’  needs,  to  discover  and  act  upon  the  skills  and 
interests  of  the  PUC  employees,  and  to  aid  in  the  career 
development  of  the  PUC  employees.  With  extensive 
recommendations  from  the  PUC  manager,  the  alliance  employee 
coordinated  training  schedules,  speakers,  room  arrangements,  and 
handout  materials.  The  project  manager  and  the  alliance  employee 
organized  a series  of  brown-bag  lunch  information  sessions,  a 
construction  manager  training  course,  and  a project  engineering 
class.  In  addition,  these  individuals  sent  two  skills  and  goals 
surveys  to  PUC  staff  that  the  PUC  will  use  to  create  a database  of 
employee  skills  and  interests. 

The  project  manager  rated  the  quality  of  work  and  deliverables  on 
this  task  order  as  excellent.  He  said  that  the  principal  alliance 
employee  did  an  outstanding  job  of  organizing  and  administering 
the  training  programs  in  an  innovative  manner  and  that  she  worked 
well  with  PUC  staff.  The  alliance  employee  drafted  weekly  written 
updates  and  consulted  with  the  PUC  project  manager  by  phone  as 
needed.  The  PUC  project  manager  told  us  that  he  views  the 
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The  quality  of  work  for 
three  task  orders 
received  relatively  low 
evaluation  scores. 


The  PUC  expressed 
dissatisfaction  with  the 
program  management 
information  system. 


training  program  as  a big  success  that  has  resulted  from  the  PUC’s 
agreement  with  the  alliance. 


The  Alliance  Received  Evaluation  Scores 

Indicating  That  Some  Work  Was  Less  Than  Satisfactory 

Although  the  PUC  found  that  all  of  the  alliance’s  work  related  to 
engineering  was  at  least  satisfactory,  three  tasks  received 
evaluation  scores  of poor  or  needs  improvement  in  the  “quality  of 
work”  category.  These  tasks  involved  the  program  management 
information  system,  the  communication  and  outreach  program,  and 
the  diversity  program.  However,  the  overall  evaluation  score  for 
the  program  management  information  system  was  3,  meets 
requirements.  The  communication  and  outreach  program  also 
received  an  overall  score  of  3,  meets  requirements.  On  the  other 
hand,  most  scores  for  the  diversity  program  were  low,  so  this 
program’s  overall  score  was  \,poor. 


The  PUC  Believes  That  the  Program  Management 
Information  System  Needs  Improvement 

The  PUC’s  project  manager  for  the  program  management 
information  system  (system),  task  order  24,  rated  the  alliance’s 
quality  of  work  and  deliverables  as  needs  improvement.  The 
project  manager  told  us  that  he  did  not  actively  manage  this  task 
because  he  thought  that  the  alliance  was  supposed  to  do  so. 

The  task  order  authorized  the  alliance  to  develop  the  program 
management  information  system  for  monitoring  and  analyzing  the 
budget,  cost,  and  performance  of  the  CIP  at  both  a project  and  a 
program  level.  The  task  order  did  not  describe  the  work  that  the 
alliance  was  to  perform;  rather,  the  task  order  described  the 
system,  its  purpose,  and  a breakdown  of  the  system’s  total  cost, 
which  was  not  to  exceed  $194,794.  Originally,  the  alliance  was  to 
complete  the  work  between  February  5,  2001,  and  June  30,  2001. 
The  PUC  later  extended  the  deadline  to  August  31,  2001. 

The  project  manager  was  not  the  only  person  to  express 
dissatisfaction  with  the  system.  According  to  meeting  notes  taken 
by  the  PUC,  during  a demonstration  of  the  system  in  February 
2002,  the  PUC  staff  attending  the  demonstration  believed  that  it 
did  not  receive  a full  demonstration  of  the  software.  The  meeting 
notes  state  that  the  demonstration  did  not  show  menus,  data-entry 
screens,  explanations  of  how  to  set  up  projects,  or  the  process  for 
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budgeting  or  entering  data.  The  meeting  notes  do  state  that  the 
alliance  did  complete  the  cost  control  facet  of  the  system. 

However,  the  notes  do  not  explain  how  the  PUC  reached  that 
conclusion,  since  they  do  not  refer  to  any  demonstration  of  the  cost 
control  software. 

The  meeting  notes  also  show  that  the  PUC  was  asking  questions 
that  it  should  have  asked  before  it  assigned  to  the  alliance  the  task 
of  developing  the  program  management  information  system.  For 
example,  participants  at  the  demonstration  asked  questions  about 
the  amount  of  resources  needed  to  manage  the  system,  about  the 
system’s  strengths,  and  about  methods  for  maintaining  and 
managing  the  program  hardware  and  software.  Also,  participants 
seemed  not  to  understand  that  the  task  order  requested  only  a cost 
control  system.  Instead,  according  to  the  notes,  the  PUC’s  task 
order  needed  to  specify  what  the  PUC  really  wanted:  a system  that 
includes  planning  and  scheduling  tools,  progress  and  performance 
reports  on  engineering,  and  a change  management  system. 
Apparently,  many  PUC  staff  members  were  not  aware  of  the  task 
order’s  limited  scope. 

Although  many  PUC  staff  appeared  to  be  dissatisfied  with  the 
project  management  information  system,  we  did  speak  with  one 
PUC  employee,  who  was  trained  by  the  alliance,  to  enter  data  into 
the  system.  He  stated  that  the  system  did  work  and  is  basically  a 
cost  control  program.  However,  he  added  that  the  PUC  project 
managers  do  not  have  the  necessary  cost  information  to  enter  into 
the  system,  and  that  is  why  the  system  cannot  be  used. 

At  this  point,  the  PUC  has  already  made  a $190,000  investment  in 
the  program  management  information  system.  Apparently,  the 
PUC  did  not  complete  the  necessary  planning  before  it  created  the 
task  order.  We  asked  the  project  manager  whether  the  PUC  would 
use  the  software,  and  he  indicated  that  parts  of  it  are  usable  but  that 
the  PUC  probably  would  not  use  the  present  form.  He  added  that 
the  PUC  would  most  likely  purchase  another  system.  However, 
according  to  the  CIP  manager,  about  40  percent  of  the  existing 
system  is  salvageable. 


The  PUC  Views  the  Alliance’s  Work  on  the 
Communication  and  Outreach  Project  As  Inadequate 


Another  project  that  the  PUC  identified  as  needs  improvement  was 
the  communication  and  outreach  project,  task  order  24.  The  task 
order  directs  the  alliance  to  coordinate  public  outreach,  prepare  a 
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Elements  of  the 
communication  and 
outreach  project  need 
revision. 


The  diversity  program 
received  the  lowest 
possible  rating. 


CIP  brochure,  create  CIP  PowerPoint  presentations,  and  train  the 
PUC  staff  to  perform  these  tasks.  On  her  evaluation,  the  project 
manager  indicated  that  the  work  needs  improvement.  Because  the 
evaluation  does  not  list  the  specific  elements  that  made  the  work 
unsatisfactory,  and  because  the  previous  evaluation  rated  the 
alliance’s  work  as  exceeds  requirements,  we  interviewed  the 
project  manager  to  determine  the  exact  cause  of  the  problems  with 
the  alliance’s  work. 

According  to  the  project  manager,  she  had  managed  the 
communication  and  outreach  project  for  just  three  months.  She 
stated  that  the  brochure  was  not  satisfactory  and  that  it  was  being 
revised.  In  addition,  the  PowerPoint  presentation  also  needed 
revision,  so  the  PUC  brought  in  a new  consultant  to  take  over  the 
project.  Nonetheless,  the  project  manager  was  pleased  with  the 
staff  training  provided  by  the  alliance.  She  said  that  the  alliance 
employee  did  a very  good  job  in  working  with  PUC  staff  and  that 
the  employee  trained  the  staff  in  preparing  PowerPoint 
presentation  and  in  developing  databases. 


The  Alliance’s  Work  on  the  Diversity  Program  Needs 
Revision 

The  two  project  managers,  one  fi:om  the  PUC  and  one  from  the 
Human  Rights  Commission,  who  are  in  charge  of  the  diversity 
program,  task  order  25,  gave  the  lowest  possible  rating  to  the 
alliance’s  work  on  the  task  order.  The  PUC  created  the  original 
task  order  for  the  diversity  program  to  establish  programs  that  will 
maximize  the  participation  of  minorities,  women,  and  local 
businesses  in  the  CIP.  The  key  tasks  were  to  target  outreach  to 
increase  participation  in  the  CIP  by  minority-owned  business 
enterprises  and  women-owned  business  enterprises,  to  implement  a 
technical  and  business  assistance  program,  to  create  a monthly 
report  for  tracking  the  diversity  program  performance,  and  to 
establish  a job  training  and  placement  program  for  the  CIP. 

According  to  the  project  managers,  the  key  tasks  listed  deadlines 
for  deliverables  that  the  alliance  did  not  meet.  The  project 
managers  expressed  frustration  with  the  alliance  and  said  that  the 
alliance  never  asked  the  project  managers  what  they  wanted.  Also, 
even  after  several  requests  by  the  project  managers  for  more 
information,  the  alliance  did  not  inform  the  project  managers  about 
the  staff  assigned  to  the  task  or  about  the  exact  details  of  work 
performed.  One  project  manager  said  that  she  did  not  receive  an 
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invoice  for  services  rendered  until  several  months  after  the  work 
began. 

Dated  August  8,  2001,  a draft  letter  from  the  alliance  to  one  of  the 
project  managers  acknowledges  that  the  alliance  did  not  fulfill 
many  of  the  task  order’s  requirements.  The  alliance  suggested 
revisions  to  the  task  order;  nevertheless,  the  project  managers 
directed  the  alliance  to  stop  work  on  the  task  at  the  end  of  August 
2001 . Alliance  work  did  not  resume  on  the  task  until  the  PUC 
created  a revised  task  order  25  revision  B on  December  24,  2001. 

Currently,  the  project  managers  indicates  that  they  are  pleased  with 
the  alliance’s  performance  under  revised  task  order,  and  their 
evaluations  have  rated  the  current  quality  of  work  as  exceeds 
requirements. 


THE  AGREEMENT  LACKS  ADEQUATE 
PERFORMANCE  MEASURES 

The  alliance  substantially  met  short-term  performance  measures 
for  the  first  year  of  the  agreement,  but  long-term  performance 
measures  are  not  yet  applicable.  The  agreement  between  the  PUC 
and  the  alliance  contains  short-term  and  long-term  key 
performance  measures  as  well  as  related  goals  and  objective.  (See 
appendices  C and  D).  A performance  measure  is  a quantitative 
indicator  of  how  well  an  organization  is  fulfilling  its  mission, 
goals,  or  objectives.  Performance  measures  allow  the  PUC  to 
evaluate  whether  its  resources  are  used  for  maximum  benefit,  to 
provide  accountability  to  the  PUC  and  the  City,  and  to  track  the 
improvement  in  the  programs  and  services  that  the  alliance 
provides.  Also,  the  PUC,  with  input  from  the  board’s  budget 
analyst,  commissioned  an  independent  peer  review  panel  (panel)  to 
evaluate  the  alliance’s  performance  in  the  first  year  of  the 
agreement.  The  panel  was  comprised  of  two  engineers  from  the 
firm  of  Malcolm  Pimie,  Inc.  (a  private  company  of  environmental 
engineers,  scientists,  and  planners)  and  the  Deputy  City  Manager 
of  the  City  of  Las  Vegas. 


The  Alliance  Substantially  Achieved  Short-Term  Key 
Performance  Measures 

The  agreement  identifies  seven  performance  measures  that  the 
alliance  was  to  meet  in  the  first  year  of  the  agreement.  It  is  the 
opinion  of  the  panel,  based  on  information  provided  by  the  PUC 


staff,  that  the  alliance  has  substantially  achieved  almost  all  of  the 
short-term  key  performance  measures. 


The  alliance  met  six  of 
the  seven  short-term 
key  performance 
measures. 


According  to  the  panel,  one  performance  measure  that  the  alliance 
did  not  meet  was  the  minority  and  woman  owned  business 
enterprise  (MBE/WBE)  participation.  The  panel  does  not  believe 
that  this  is  a major  concern  because  the  alliance’s  MBEAVBE 
participation  was  strong  during  the  latter  portion  of  the  first  year. 
The  panel  further  states  that  the  alliance  is  well  positioned  to  meet 
or  exceed  the  performance  measure  by  the  end  of  the  four-year 
agreement  term.  Furthermore,  we  do  not  believe  this  is  a major 
concern  because  the  agreement  does  not  state  that  the  MBE/WBE 
participation  must  be  fiilly  met  in  the  first  year. 

The  alliance  only  partially  achieved  short-term  key  performance 
measure  number  seven.  This  performance  measure  required  the 
alliance  to  develop  criteria  and  methodology  for  measuring 
performance  related  to  the  earning  of  the  incentive-based 
performance  fee.  Beginning  in  the  second  year,  a performance  fee 
of  between  0 and  4.5  percent  is  payable  based  on  performance 
against  mutually  agreed  benchmarks.  For  fiscal  year  2001-2002, 
the  PUC  and  the  alliance  agreed  on  35  short-term  goals  for  the  first 
six-months  of  the  evaluation  and  22  goals  for  the  second  six-month 
evaluation  or  a total  of  57  goals.  The  alliance’s  performance 
against  these  goals,  as  determined  by  the  PUC,  will  be  used  to  pay 
the  incentive  fee.  Beginning  in  the  second  year  of  the  agreement,  a 
portion  of  the  alliance’s  compensation  will  come  in  the  form  of  an 
incentive  fee  that  is  tied  to  actual  performance.  The  incentive- 
based  fee  would  be  calculated  every  six-months  and  has  a second 
year  maximum  of  4.5  percent  of  total  agreement  costs.  The  PUC 
staff  believes  that  this  performance  measure  has  been  partially 
achieved  because  negotiations  are  ongoing  between  the  PUC  and 
the  alliance  regarding  the  measures  to  be  used  in  the  second  year  of 
the  agreement. 

The  panel  has  concerns  regarding  the  57  proposed  goals  currently 
under  discussion  for  the  second  year  of  the  agreement.  While  the 
brevity  of  the  peer  review  process  precluded  the  panel  fi*om 
discussing  these  performance  measures  in  any  detail  with  the  PUC 
and  alliance  staff  members,  the  panel  found  that  many  of  the  57 
measures  were  not  quantifiable,  and  were  confusing,  based  upon 
unstated  baseline  values,  or  vague.  Moreover,  the  panel  beheves 
that  there  are  simply  too  many  performance  measures  to 
effectively  monitor  performance  for  the  second  year.  According  to 
the  peer  review  panel,  it  is  likely  that  a much  smaller  set  of 
performance  measures  could  be  developed  that  more  effectively 
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measures  the  alliance’s  performance  and  minimize  the  amount  of 
confusion  and  paperwork  attendant  with  reporting  on  numerous 
measures  each  month. 

According  to  the  board’s  budget  analyst,  he  remains  concerned  that 
eight  of  the  proposed  goals  are  insufficiently  specific  and 
measurable  for  the  purpose  of  determining  whether  the  alliance  has 
met  the  goals  and  earned  the  incentive  fees  because  quantifiable 
targets  for  achievement  are  not  identified. 

According  to  the  PUC  program  manager  (program  manager)  for 
the  alliance  agreement,  the  focus  of  the  agreement  shifted  from 
performance  measures  to  task  order  deliverables.  This  was  because 
the  amount  of  funding  for  the  program  management  office  was 
limited  to  $3  million  by  the  board  in  November  2001 . Due  to  the 
limited  funding,  and  the  implied  decrease  in  the  duration  of  the 
agreement’s  period  of  performance,  the  PUC  did  not  believe  that  it 
should  revise  the  performance  measures;  instead,  all  second  year 
task  orders  have  established  deliverables  and  due  dates. 

The  budget  analyst  recommends  that  payment  of  the  incentive  fee 
be  subject  to  the  PUC’s  and  board’s  approval.  He  further 
recommends  that  the  incentive  fee  goals  for  the  second  year  of  the 
agreement  specifically  include  a quantifiable  objective  for  timely 
completion  of  PUC  approved  task  orders. 


Long-Term  Key  Performance  Measures  Need  Revision 

The  agreement  identifies  eight  long-term  key  performance 

measures  addressing  program  measures,  program  schedules  and 
Many  long-term  key  program  commimity/social  goals. 
performance  measures 

are  not  yet  applicable.  Based  on  the  peer  review  report,  the  PUC  staff  believes  that  only 

one  of  the  eight  performance  measures  has  been  achieved  during 

the  first  year  of  the  agreement.  The  other  seven  performance 
measures  are  generally  regarded  as  not  yet  applicable  or  that  the 
related  activities  are  still  ongoing. 

The  panel  believes  that  a more  fundamental  revision,  such  as 
adopting  a mission  statement,  of  the  long-term  key  performance 
measures  is  required.  The  panel  also  believes  that  performance 
measures  should  be  established  within  each  task  order  to  eliminate 
the  “disconnect”  currently  occurring  between  the  task  orders  issued 
and  the  previously  defined  performance  measures.  This  will  force 
the  authors  of  the  task  orders  to  think  specifically  about  the 
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The  PUC  paid  the 
alliance  $3,697,428  In 
approved  invoices. 


objectives,  work  products,  and  desired  outcomes  of  each  task 
order.  The  budget  analyst  concurred  with  the  panel’s 
recommendations  and  further  recommends  that  the  agreement 
between  the  PUC  and  the  alliance  be  amended  to  incorporate  this 
as  a requirement. 


THE  ALLIANCE  GENERALLY  COMPLIES  WITH 
ITS  AGREEMENT’S  COMPENSATION 
PROVISIONS 

The  San  Francisco  Water  Alliance  complies  with  most  aspects  in 
the  compensation  provisions  of  its  agreement  with  the  Public 
Utilities  Commission  (PUC).  However,  the  PUC  is  sometimes 
slow  in  paying  the  alliance,  even  though  the  alliance  generally 
followed  the  requirement  for  submitting  its  invoices  with 
supporting  records  and  documents.  Our  audit  also  revealed  that  the 
alliance  and  its  subconsultants  billed  the  PUC  incorrectly  for  some 
payroll  costs  when  the  alliance  used  incorrect  payroll  rates  for  a 
few  staff.  In  addition,  the  alliance  did  not  obtain  prior  approval  for 
incurring  other  direct  charges  and  the  PUC  has  not  approved 
payments  for  other  direct  charges  that  the  alliance  incurred. 


The  PUC  Is  Slow  in  Paying  the  Aiiiance 

According  to  the  agreement,  the  PUC  should  pay  the  alliance 
within  30  days  after  the  PUC  has  received  a satisfactory  invoice. 
However,  the  PUC  often  paid  the  alliance  one  to  five  weeks  late. 
Out  of  the  1 18  invoices  the  alliance  submitted  to  the  PUC  for 
payment,  we  found  that  the  PUC  paid  77  (65  percent)  of  the  total 
invoices  late.  Although  67  (87  percent)  of  the  77  invoices  were 
paid  fi*om  2 to  9 days  late,  the  PUC  paid  10  (13  percent)  of  the 
invoices  fi-om  2 to  6 weeks  late.  According  to  the  PUC’s  program 
manager,  the  PUC  did  not  pay  all  the  expenses  listed  on  the 
invoices  within  the  required  30  days  requirement  because  some  of 
the  expenses  required  further  explanation  and  documentation  by 
the  alliance. 

The  alliance  submitted  invoices  totaling  $3,747,274  for  services 
rendered  fi-om  June  2001  through  November  2001  and  we 
reviewed  a sample  of  these  invoices.  As  of  February  22,  2002,  the 
PUC  paid  the  alliance  $3,697,428  of  the  total,  and  the  PUC  is 
withholding  payment  of  $49,846.  The  table  below  details  monthly 
invoices  and  payments. 
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Table 


San  Francisco  Water  Alliance 
Invoices  Submitted  and  Then  Paid  by  the  PUC 
As  of  February  22,  2002 


Month  During 
2001 

Number  of 
Invoices 

Total  Amount  on 
Invoices 

Amount 
Paid  by  PUC 

Amount  Not  Paid 
by  PUC 

June 

20 

$589,603 

$589,603 

$ 0 

July 

22 

726,019 

726,019 

0 

August 

21 

662,557 

655,252 

7,305 

September 

20 

562,975 

547,547 

15,428 

October 

19 

552,927 

526,909 

26,018 

November 

16 

653,193 

652,098 

1,095 

Total 

118 

$3,747,274 

$3,697,428 

$49,846 

For  the  invoices  we  reviewed,  which  totaled  $1,804,871,  the 
alliance  usually  followed  requirements  in  the  agreement  when 
submitting  the  bills.  We  reviewed  supporting  documents,  such  as 
timesheets,  and  found  them  in  order.  However,  the  alliance  made  a 
few  errors  in  billing  the  PUC  for  some  payroll  costs. 


The  alliance  billed 
incorrect  hourly 
rates  for  a few 
employees. 


The  Alliance  Made  Some  Errors 
Billing  the  PUC  for  Payroll  Costs 

The  alliance  and  one  of  its  subconsultants  made  a few  mistakes 
when  it  billed  the  PUC  for  some  payroll  costs.  In  our  previous 
audit  report,  we  had  also  identified  a few  instances  in  which  the 
alliance  and  its  subconsultants  incorrectly  billed  the  PUC  for 
certain  staffs  pay. 

During  our  current  review,  we  reviewed  the  billing  rates  for  a 
sample  of  employees  who  worked  for  the  alliance  or  for  its 
subconsultants.  Our  review  disclosed  that  the  alliance  billed  the 
PUC  for  two  alliance  employees  at  rates  exceeding  the 
agreement’s  maximum  billing  rate,  which  is  not  to  exceed  $140 
per  hour  for  each  member  of  the  consultant’s  staff  who  is  regularly 
assigned  to  the  project.  This  overbilling  led  the  PUC  to  overpay  the 
alliance  by  $8,359.  Additionally,  in  the  sample  of  invoices  that  we 
reviewed,  another  invoice  showed  that  a subconsultant  used  an 
incorrect  billing  rate  for  one  of  its  employees,  resulting  in  an 
underpayment  to  the  alliance  of  $629.  The  net  result  from  the 
errors  was  that  the  PUC  overpaid  the  alliance  and  its  subconsultant 
by  $7,730. 
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The  alliance  incurred 
other  direct  charges 
without  prior  approval. 


When  we  discussed  the  payment  errors  with  the  alliance’s  business 
manager,  she  stated  that  the  staff  members  we  identified  were  not 
regularly  assigned  to  the  project  and  therefore  were  not  subject  to 
the  agreement’s  maximum  hourly  rate.  However,  the  program 
manager  indicated  to  us  that  the  agreement  specifies  that  the 
PUC’s  general  manager  must  approve  in  writing  any  exceptions  to 
the  maximum  billing  rate.  Further,  we  found  that  there  is  no 
definition  of  regularly  assigned  staff  in  the  agreement,  and 
therefore  it  would  be  difficult  to  make  such  a determination. 


The  Alliance  Did  Not  Obtain  Approval  To 
Incur  Other  Direct  Charges 

When  we  reviewed  the  $3,765  other  direct  charges  the  alliance 
submitted  to  the  PUC,  we  found  that  the  alliance  purchased  $1,223 
in  computer  equipment  without  pre-approval  from  the  manager  of 
the  PUC’s  Utilities  Engineering  Bureau.  According  to  the 
agreement,  the  PUC’s  approval  is  required  before  the  alliance  can 
make  purchases  that  are  in  the  agreement’s  category  of  “other 
direct  charges.” 

In  addition,  the  PUC  has  not  paid  a total  of  $9,936  in  other  direct 
charges  that  the  alliance  incurred  during  the  months  of  March  2001 
through  May  2001.  According  to  the  alliance,  the  PUC  has  not 
paid  the  alliance  for  these  charges  because  there  was  no  pre- 
approval from  the  PUC  when  the  alliance  incurred  these  charges. 

Also,  because  the  alliance  did  not  obtain  pre-approval  of  other 
direct  charges  totaling  $25,671,  it  has  not  yet  billed  the  PUC  for 
additional  other  direct  charges  that  the  alliance  incurred  fi-om  June 
2001  through  December  2001.  According  to  the  alliance,  although 
the  other  direct  charges  were  part  of  the  budgeted  costs  under  task 
orders,  the  alliance  still  seeks  approval  from  the  PUC  before  the 
alliance  bills  the  other  direct  charges  to  the  PUC.  According  to  the 
alliance,  it  submitted  to  the  PUC  for  its  approval  other  direct 
charges  totaling  $3,578  on  January  18, 2002  and  $22,093  on 
February  12,  2002  for  a total  of  $25,671.  However,  as  of  March 
12,  2002,  the  PUC  has  not  yet  approved  the  other  direct  charges. 
As  a result,  the  alliance  has  not  yet  billed  the  PUC  the  other  direct 
charges  totaling  $25,671. 
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Bechtel  performed  a 
review  rather  than  an 
audit. 


Bechtel  adequately 
reviewed  the  overhead 
costs  submitted  by  the 
alliance’s 
subconsultants. 


BECHTEL  INFRASTRUCTURE  CORPORATION 
APPEARS  TO  HAVE  REVIEWED  ADEQUATELY 
THE  OVERHEAD  COSTS  SUBMITTED  BY  THE 
ALLIANCE’S  SUBCONSULTANTS 

In  reviewing  the  costs  that  the  alliance  charged  the  PUC,  we 
learned  that  a report  prepared  by  Bechtel  Infrastructure 
Corporation  (Bechtel),  at  its  own  cost,  had  recommended  different 
overhead  costs  for  some  of  the  alliance’s  subconsultants. 

According  to  the  agreement  between  the  PUC  and  the  alliance, 
before  the  end  of  the  agreement’s  first  year,  Bechtel  will 
coordinate  with  consultant  members  to  produce  an  audit  of  the 
overhead  costs  and  resulting  rates  for  each  consultant  member, 
performed  in  accordance  with  the  standards  of  the  Code  of  Federal 
Regulations,  Federal  Acquisition  Regulations,  Title  48,  Chapter  1. 
However,  we  noted  that  Bechtel’s  internal  audit  department 
performed  a review  rather  than  an  audit. 

We  also  determined  that  the  review  procedures  performed  by 
Bechtel’s  internal  audit  department  appear  adequate  and  that  they 
properly  support  the  report’s  information. 

Titled  “Review  of  Consultant  and  Subconsultant  2000  Overhead 
Rates,”  the  report,  issued  by  Bechtel’s  internal  audit  department  on 
August  30,  2001,  examined  the  overhead  rates  for  eight  of  the 
alliance’s  subconsultants.  For  five  subconsultants,  the  report 
recommended  lower  overhead  rates  than  those  submitted.  For  the 
remaining  three  consultants,  Bechtel  accepted  their  rates  as 
submitted  to  the  PUC.  The  field  rates  remained  at  the  approved 
agreement  rate  for  seven  of  the  eight  subconsultants.  However,  for 
one  subconsultant,  the  Bechtel  report  recommended  a lower  rate 
than  either  the  approved  agreement  rate  or  the  rate  already 
submitted  by  this  subconsultant. 

Although  Bechtel  reviewed  the  overhead  rates  of  the  alliance’s 
subconsultants,  we  believe  that  one  prime  consultant  - Jefferson 
Company  and  one  subconsultant  - Whitted  Dawson  - require 
further  review  because  Bechtel’s  review  revealed  that  these  two 
companies’  actual  overhead  rates  exceeded  the  agreement  ceiling 
for  such  rates.  In  addition,  the  amount  of  Whitted  Dawson’s  direct 
salaries  seemed  unusually  low  in  relation  to  the  overhead  expenses 
listed  on  its  invoices.  Whitted  Dawson  also  engaged  two 
independent  contractors  to  perform  work  under  the  agreement  and 
then  applied  the  overhead  rates  to  the  fees  that  it  paid  to  the 
independent  contractors.  Because  the  agreement  allows  consultants 
to  apply  overhead  rates  only  to  actual  direct  salaries,  the  PUC 


20 


should  review  all  invoices  submitted  by  Whitted  Dawson  and 
determine  the  amount  that  was  incorrectly  paid  as  overhead. 
Furthermore,  because  Bechtel’s  internal  audit  department 
performed  only  a review  rather  than  an  audit,  the  PUC  needs  a 
more  detailed  analysis  to  determine  whether  the  costs  included  in 
the  overhead  rates  comply  with  the  Code  of  Federal  Regulations, 
Federal  Acquisition  Regulations,  Title  48,  Chapter  1.  The 
agreement  between  the  PUC  and  the  alliance  requires  such 
compliance  by  consultant  members. 


RECOMMENDATIONS 

If  the  Board  of  Supervisors  approves  the  continuation  of  the 
agreement  for  another  year,  the  Public  Utilities  Commission 
should  revise  the  long-term  key  performance  measures  as 
recommended  by  the  independent  peer  review  panel  and  the 
board’s  budget  analyst. 

To  ensure  that  the  San  Francisco  Water  Alliance  fulfills  the 
compensation  provisions  of  its  agreement  with  the  PUC,  the  PUC 
should  take  the  following  actions: 

• Inform  the  alliance  promptly  about  any  amounts  that  it 
disallows  or  does  not  pay  so  that  the  alliance  can  provide 
the  necessary  documentation  to  support  its  expenses. 

• Require  the  alliance  to  review  the  billing  rates  for  the 
invoices  we  did  not  examine  so  that  it  can  identify  any 
other  payroll  errors  made  by  the  alliance  or  its 
subconsultants.  The  alliance  should  submit  to  the  PUC  the 
detailed  results  of  the  alliance’s  review.  The  PUC  should 
then  analyze  the  results  so  that  it  can  ensure  that  the 
alliance  and  its  subconsultants  are  billing  the  proper  rates 
for  their  employees.  To  do  so,  the  PUC  needs  to  verify  that 
the  hourly  rates  listed  on  the  invoices  are  identical  to  the 
hourly  rates  that  employees  actually  receive  and  to  confirm 
that  the  rates  do  not  exceed  the  amounts  allowed  by  the 
agreement.  The  PUC  should  also  require  the  alliance  to 
reduce  future  invoices  by  any  amounts  that  the  PUC 
overpaid  because  of  incorrect  hourly  rates. 

• Verify  that  the  alliance  and  its  subconsultants  bill  only  for 
the  rates  that  it  pays  to  employees  by  requiring  that  the 
alliance  submit  employees’  pay  registers  and  timesheets 
with  the  invoices. 


21 


• Review  further  the  overhead  rates  for  Jefferson  Company 
and  Whitted  Dawson. 

We  conducted  this  review  according  to  generally  accepted 
government  auditing  standards.  We  limited  our  review  to  those 
areas  specified  in  the  audit  scope  section  of  this  report. 


Staff:  Carmen  LeFranc,  Audit  Manager 
Ann  Foley 
Shawna  Paulson 
Leon  Valle,  Jr. 

Helen  Vo 
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APPENDIX  A 


The  PUC’s  Evaluations  of  the  San  Francisco  Water  Alliance 
Completed  and  Interim  Task  Orders  1-30  for  Year  One  of  the  Agreement 
As  of  November  25,  2001 


Evaluation  Scores* 


Task 

Order 

Description 

Completed 

or 

Interim 

Quality 

of 

Work 

Adherence 
to  Project 
Schedule 

Adherence 
to  Project 
Budget 

Task 

Manage- 

ment 

Average 

Evaluation 

Score 

Invoiced 
Costs  As  of 
Nov  25,  2001 

Budgeted 
Cost  As  of 
Nov  25,  2001 

1 

Interim  Insurance 

C 

3 

3 

3 

4 

3 

$251,198 

$251,198 

2 

Start-up  and  Team  Building 

C 

4 

2 

4 

3 

3 

71,668 

71,982 

3 

Program  Management  Office  Tasks 

c 

3 

3 

4 

3 

3 

2,457,612 

2,460,000 

I 4 

Owner-Controlled  Insurance 
Program  Risk  Assessment 

c 

4 

2 

5 

4 

4 

12,187 

12,187 

5 

Capital  Improvement  Program 
10  Year  Plan 

c 

4 

4 

4 

4 

4 

449,702 

461 ,500 

6 

Hatch  Hetchy  Project  / Chloramine 
Conversion  Project 

c 

5 

5 

4 

5 

5 

343,866 

507,806 

7 

SFPUC  Facilities  Reliability  Program 
Phase  III 

c 

5 

5 

5 

5 

5 

5,765 

5,765 

8 

Millbrae  Admin.  Bldg.  Seismic 
Upgrade 

c 

3 

3 

3 

3 

3 

1,677 

1,677 

9 

Sunol  Valley  Water  Treatment  Plant 
Improvements  - Phase  1 

c 

3 

3 

4 

3 

3 

17,981 

17,981 

i 10 

Program  Manager  Support  for  1995B 
Sewer  Bond  Projects 

c 

3 

2 

3 

4 

3 

216,851 

218,500 

' 11 

Moccasin  Communication 

c 

4 

4 

4 

5 

4 

559 

559 

12 

Priest  Reservoir  Bypass 

c 

3 

3 

4 

3 

3 

2,904 

2,904 

13 

Estimating  for  Sewer  and  Sewer 
Systems  Contracts 

c 

3 

4 

4 

4 

4 

56,370 

74,600 

14 

Solids  Handling  Upgrade 

c 

4 

3 

3 

3 

3 

275,187 

318,294 

15 

Cost  Estimating 

c 

3 

3 

3 

3 

3 

120,973 

120,973 

16 

Reliability  Program  Phase  III 

1 

5 

4 

5 

5 

5 

600,565 

904,602 

17 

SF  Water  Supervisory  Control  and 
Data  Acquisition  System 

c 

4 

3 

3 

2 

3 

24,830 

24,830 

18 

Crystal  Springs  Bypass  Conduit 

c 

5 

4 

5 

5 

5 

66,125 

67,000 

19 

Sunol  Valley  Water  Treatment 
Program 

1 

5 

3 

5 

5 

5 

19,191 

39,238 

20 

Intertie  Pipeline  and  Pump  Station 

1 

3 

2 

3 

3 

3 

141,781 

197,250 

21 

Program  Management  Services  - 
Staff  Training 

c 

5 

5 

5 

5 

5 

123,710 

128,625 

22 

Project  Management  Services  - 
Project  Control  Support 

c 

3 

3 

3 

3 

3 

176,276 

180,836 

23 

Program  Management  Information 
System  Monitor  and  Control 

c 

2 

3 

3 

3 

3 

133,882 

194,794 

24 

Program  Management  Services  - 
Communication  and  Outreach 

c 

2 

3 

3 

3 

3 

234,747 

263,711 

25 

Program  Management  Services  - 
Diversity  Program 

1 

1 

1 

2 

1 

1 

199,658 

366,936 

25 

Program  Management  Services  - 
Diversity  Program  (Revision  B) 

1 

4 

3 

3 

4 

4 

■ 

' 

26 

Cost  Estimating  Group  Training 

c 

3 

3 

3 

3 

3 

104,344 

120,083 

R 27 

Sunol  Valley  Water  Treatment 
Program  - Phase  1 Improvement 

1 

4 

4 

4 

4 

4 

58,598 

102,602 

S 28 

Intertie  Pipeline  and  Pump  Station 

c 

3 

3 

3 

3 

3 

11,346 

50,000 

29 

Program  Management  Contract 

c 

4 

3 

4 

3 

4 

24,809 

24,975 

I:  30 

Priest  Reservoir  Bypass 

c 

3 

3 

3 

4 

3 

45,615 

48,955 

Total 

$6,249,977 

$7,240,363 

5=Excellent 

4=Exceeds  Requirements 
3=Meets  Requirements 
2=Needs  Improvement 
1=Poor 
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APPENDIX  A 


The  PUC’s  Evaluations  of  the  San  Francisco  Water  Alliance 
Completed  and  Interim  Task  Orders  31  - 40  for  Year  One  of  the  Agreement 
As  of  November  25,  2001 


Evaluation  Scores* 


Task 

Order 

Description 

Completed 

or 

Interim 

Quality 

of 

Work 

Adherence 
to  Project 
Schedule 

Adherence 
to  Project 
Budget 

Task 

Manage- 

ment 

Average 

Evaluation 

Score 

Invoiced 
Costs  As  of 
Nov  25,  2001 

Budgeted 
Cost  As  of 
Nov  25,  2001 

31 

Baylands  Recovery  Project 

I 

4 

4 

4 

4 

4 

121,462 

124,500 

32 

Water  Supply  & Treatment 
Peninsula  Improvement  Project 

C 

5 

3 

4 

4 

4 

204,163 

374,712 

33 

Program  Management  -Capital 
Improvement  Program  2000  Update 

C 

5 

5 

5 

5 

5 

96,496 

99,158 

34 

Priest  Reservoir  Bypass  Pipeline 

I 

3 

3 

3 

4 

3 

8,912 

29,425 

35 

Cancelled 

N/A 

N/A 

N/A 

N/A 

N/A 

N/A 

- 

- 

36 

Sludge  Conveyance  Revie\w 

C 

4 

3 

3 

4 

4 

15,979 

26,824 

37 

Program  Management  - Scoping  of 
Regional  Water  Facilities  Planning 

C 

3 

3 

3 

3 

3 

6,285 

10,000 

38 

Lower  Crystal  Springs  Dam 
Abutment  Protection 

I 

5 

5 

5 

5 

5 

8,946 

36,733 

39 

A & B Projected  Spending 

c 

5 

2 

5 

4 

4 

28,448 

30,000 

40 

San  Joaquin  Pipe  Line  River 
Discharge  Improvements 

c 

3 

3 

3 

4 

3 

2,500 

Total 

$490,691 

$733,852 

5=Excellent 

4=Exceeds  Requirements 
3=Meets  Requirements 
2=Needs  Improvement 
1=Poor 

N/A  = Not  Available 
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APPENDIX  B 


The  PUC’s  Evaluations  of  the  San  Francisco  Water  Alliance 
Interim  Task  Orders  41  - 52  for  Year  Two  of  the  Agreement 
As  of  November  25,  2001 


Evaluation  Scores 


Task 

Order 

Description 

Possible 

Score 

Total 

Score 

Achieved 

Invoiced 
Costs  as  of 
Nov  25,  2001 

Budgeted 
Cost  as  of 
Nov  25,  2001 

41 

Proiect  Manaaement  Office  Services 

41-2 

Update  of  Long  Range  Capital  Improvement  Program 

12 

11 

41-2 

Staff  Development  and  Training 

12 

12 

41-2 

Communications  & Public  Affairs 

9 

8 

41-2A 

Initial  Funding  (Sept  - Oct  2001) 

9 

9 

41-2B 

Project  Management  Contractor  Oversight  and  Contract  Management 

9 

7.5 

41 -2D 

Development  of  Key  Long  Range  Capital  Improvement  Plan  Procedures 

6 

4.6 

41 -2D 

Formulation  of  the  Capital  Improvement  P Organization 

6 

4 

Total  for  Program  Management  - Task  Order  41 

63 

56.1 

572,483 

3,000,000 

42-2 

San  Francisco  PUC  Security  Review 

9 

5.7 

11,889 

89,488 

43-2 

Cancelled 

- 

- 

44-2 

Water  Supply  and  Treatment  - Calaveras  Fault  Crossing 

1.26 

1.26 

204,248 

45-2 

O'Shaughnessy  Dam  Discharge  Modifications 

6 

6 

33,887 

46-2 

Water  Supply  and  Treatment  - Irvington  Tunnel  Bypass  Optioneering 

1.26 

1.12 

311,241 

47-2 

Water  Supply  and  Treatment  - Bay  Division  Pipeline  Reliability 

1.26 

1.26 

- 

250,752 

48-2 

Baylands  Recovery  Project  at  the  Former  Peninsula  Sportsmen's  Club 

12 

12 

100,000 

49-2 

Reliability  Program  Phase  III  - Facility  Evaluation  Support 

9 

9 

- 

91,891 

50-2 

Telsa  Portal/Thomas  Shaft  Facility  Optioneering 

0.9 

0.6 

- 

50,036 

51-2 

Crystal  Springs  Bypass  Tunnel  Preliminary  Engineering  Support 

N/A 

N/A 

- 

N/A 

52-2 

South  East  Water  Pollution  Control  Plant-Bldg.  840/860  Improvements 

N/A 

N/A 

• 

N/A 

Total 

$584,372 

$4,131,543 

N/A  = Not  Available 


25 


APPENDIX  C 


Goal 

# 

Short  Term  Key 
Performance 
Measures 

Goals  and  Objectives 

Alliance  1®* 
Year 

Performance 

1 

Con^lete  first  draft  of 
CIP  plan  within  3.5 
months  of  receiving 
request  for  services 

The  10-year  CIP  plan  will  show  the  cost  schedule  baseline  for  the 
projects  in  the  program  as  prioritized  by  the  PUC.  The  plan  will  be 
updated  as  required  to  reflect  changing  PUC  requirements  and  CIP 
goals.  This  will  allow  the  PUC  to  more  accurately  forecast  financing 
requirements  and  identify  MBEAVBE  contracting  opportunities  ahead 
of  time.  A consolidated  program  baseline  cost  and  schedule  will  allow 
engineering  and  construction  to  combine  similar  contracts  and 
achieve  efficiencies  in  the  program  schedule  and  cost. 

A consistent  and  reliable  CIP  baseline  cost  and  schedule  database  will 
allow  consistent  and  realistic  forecasting  and  monitoring  of  the 
program's  progress  and  performance  over  the  10-year  period. 

KPM* 

Achieved 

2 

Meet  MBEAVBE  targets 
for  the  alliance  per 
agreement  (monthly 
reports  and  annual  goals) 

The  objective  is  to  meet  or  exceed  the  overall  MBEAVBE  goals  as  set 
forth  in  the  agreement.  The  alliance  wiU  atten^t  to  provide  training  to 
all  our  subcontractors  and  JV  partners  as  needed  so  they  can  increase 
their  participation  in  this  program,  enhance  their  capabilities,  and 
grow  as  companies  during  this  time. 

On  target  to 
Achieve 

3 

Develop  a training 
program  for  PUC  staff 
within  9 months 

Training  in  areas  such  as  project  controls  and  contracts  management 
and  additional  training  in  program  management,  change/risk 
management,  safety  and  health,  will  enhance  the  capabilities  of  the 
PUC  management  team  and  allow  them  to  carry  on  the  PM  task  after 
the  alliance  agreement  is  completed. 

KPM* 

Achieved 

4 

Complete  preliminary 
PUC  staff  assessment 
within  6 months 

An  assessment  of  the  available  PUC  staff  may  enable  the  PUC  to 
better  utilize  the  existing  staff  as  well  as  provide  training  to  staff 
wanting  to  move  into  other  work  within  PUC.  This  will  also  help  the 
alliance/PUC  teams  identify  potential  candidates  to  fiU  positions  in 
the  CIP  organization,  as  they  become  available.  Training  will  also 
include  on  the  job  training,  so  in  time  a PUC  individual  can  take  over 
the  positions  currently  occupied  by  an  alliance  person. 

KPM* 

Achieved 

5 

Provide  a draft  monthly 
reporting  format  within  2 
months 

An  easy  to  read  and  understand  management  level  monthly  progress 
report  of  the  overall  program  together  with  highlights,  issues,  current 
vs.  budgeted  progress  and  performance,  as  well  as  measurable  and 
meaningful  metrics  needs  to  be  developed.  This  will  ensure  consistent 
reporting  at  a program  level  for  all  level  of  users,  and  proactive 
management  decisions  made  in  a cost  effective  and  timely  maimer. 

KPM* 

Achieved 

6 

Savings  through  value 
engineering  and 
optioneering  on  selected 
first  year  projects 

Reduce  the  cost  of  identified  tasks  by  10%  in  year  one.  Potential  tasks 
include:  chloramination  ($50M);  digester  upgrade  ($200M+);  and 
moccasin  penstocke  ($7M). 

KPM* 

Achieved 

7 

Develop  a criteria  and  a 
methodology  for 
measuring  performance 
related  to  the  earning  of 
the  performance  fee 
w'ithin  6 months 

A methodology  for  calculating  performance  fee  will  be  developed  for 
years  2,  3,  & 4. 

KPM* 

Partially 

Achieved 

• KPM  Key  Performance  Measure 
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APPENDIX  D 


Goal 

# 

Long  Term  4-Year 
Key  Performance 
Measures 

Goals  and  Objectives 

Alliance  1®* 
Year 

Performance 

1 

Overall  program  savings 

Realize  a net  savings  of  at  least  10%  ($138  million ) for 
projects 

Ongoing 

2 

Project  designs 
completed  on  schedule 

Improve  proportion  of  designs  (started  in  this  fiscal  year  or 
recently  re-forecast)  completed  on  schedule  by  25%  of 
baseline  value  in  the  first  year.  Projected  targets  for 
successive  years  are  10%,  10%,  and  5%.  These  will  be 
assessed  at  the  end  of  each  year  to  set  the  next  year's  goal. 
Currently  according  to  the  July  1999  - March  2000  report 
60%  of  the  design  projects  are  behind  schedule. 

Ongoing 

3 

Constmction  contracts 
substantially  completed 
on  schedule 

Improve  proportion  of  construction  contracts  (started  or  re- 
forecasted) in  this  fiscal  year,  achieving  substantial 
completion  on  schedule  by  25%  of  baseline  value  in  the  first 
year,  and  10%,  10%,  and  5%  in  successive  years.  These  future 
targets  will  be  reassessed  each  year  to  determine  the  new  goal. 
Currently  according  to  the  July  1999  - March  2000  report, 
26%  of  the  construction  projects  are  behind  schedule. 

Ongoing 

4 

HRC  goals  for 
MBEAVBE  participation 
in  construction  contracts 
achieved 

Monitor  and  control  the  aggregate  MBEAVBE  participation  as 
a proportion  of  HRC  goals.  The  goal  is  to  achieve  100%  of 
the  HRC  goals. 

Not  yet 
applicable 

5 

Closeout  construction 
contracts  ’within  six 
months  of  substantial 
conqjletion 

Closeout  80%  of  the  contracts  that  are  more  than  6 months 
beyond  their  substantial  conqjletion  dates  at  the  time  of  the 
Notice  to  Proceed  (NTP)  of  CIP.  Set  the  goal  for  the  second 
year  contracts  at  the  end  of  year  one. 

Ongoing 

6 

Accuracy  of  engineer's 
estimate 

Inprove  proportion  of  engineer's  estimates  within  10%  of 
median  bid  for  contracts  in  excess  of  S3  million.  The 
inprovement  target  for  year  one  is  25%.  This  will  be 
reassessed  at  the  end  of  each  succeeding  year  and  a new  goal 
set. 

Contract  Year  1 
goal  achieved 

7 

CIP  expenditure  progress 

Meet  the  planned  expenditure  profile  for  the  identified 
projects  ($1.38  billion) 

Not  yet 
applicable 

8 

Reduce  total  "services" 
costs  (project 
management, 
engineering,  construction 
management, 
procurement  etc.) 
associated  with  non- 
construction aspects  of 
the  program 

Year  1 - Develop  and  implement  a job  hour  tracking  program 
by  discipline,  by  job  change  for  the  CIP. 

Year  2 - Reduce  service  costs  by  a mutually  agreed  percent  of 
above  baseline. 

Ongoing 
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San  Francisco  Pubmc  Utilities  Commission 

1 155  Market  St..  Floor.  San  Fiwcisco.  CA  B«103  • Tel.  (ai5)  564-3155  • f=ax  (41S)  554-3161 
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FRANK  L.  COOK 
ASHOKUMARBHATT 
JEFFREY  CMEN 

PATHIOA  e.  MARTEL 
GENEFtAL  MANAGER 


Edward  Hairin^on 
Controller 

City  and  County  of  San  Francisco 
atyHail 

San  Francisco,  CA  94103 

Subject  The  San  Francisco  Water  Alliance  (SFWA)  Contract  Third  Audit  Report 
Audit  Number  01061 


Dear  Mr.  Harrington; 

The  following  are  comments  in  response  to  your  referenced  third  audit  report 

Comment:  Inform  promptly  the  alliance  about  may  amounts  that  it  disallows  or 
does  not  pay  so  that  tiie  alKance  can  provide  the  necessary  documentation  to 
support  its  expenses. 

Sime  October  2001.  the  PUC  has  been  promptly  informing  the  SFWA  regarding 
This  issue.  Curremly  this  is  not  an  issue. 


Comment:  Because  the  PUC  has  not  yet  approved  other  direct  charges  totaling 
$25,761,  the  alliance  has  not  yet  billed  fte  PUC  for  charges  the  alliance  incurred 
during  the  months  from  June  to  December. 

Response: 

These  other  direct  charges  were  returned  to  SFWA  for  clarification.  The  PUC 
will  review  these  charges  and  approve  those  submitted  by  SFWA  that  have  proper 
documentation  and  clarifications. 

Comment:  Agreement  lacks  adequate  performance  measures. 

Response: 

There  was  a change  in  direction  of  the  contract.  The  long-term  performance 
goals  were  based  on  a four-year  contract,  with  the  short-term  goals  developed  to 
support  the  long  term  ones.  With  the  shortened  duration  of  performance  and 
reduced  scope  of  work,  the  focus  of  the  agreement  shifted  j^m  performance 
measures  to  task  order  deliverables.  As  a result,  all  second  year  task  orders  had 
established  deliverables,  due  dates  and  measurement  criteria  for  performance. 
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Comment:  To  ensure  that  SFWA  fulfills  the  compensation  provisions  of  its 
agreement  with  FVC,  the  PUC  should  take  the  following  actions-  Require  ^e 
alliance  to  review  the  hilling  rates  for  the  invoices  we  did  not  examine  so  that  it  can 
identify  any  other  payroll  errors  made  by  the  alliance  or  its  sub-consultants. 

Response: 

The  PUC’s  in-house  audit  team  will  review  the  remainder  of  the  invoices  for  any 
payroll  errors.  The  PUC  will  also  request  the  sub-consultants  to  submit  employee 
pay  registers  and  timesheets  with  invoices, 

PUC  will  pursue  and  review  of  the  overhead  rates  for  Jefferson  Company  and 
Whitted  Dawson  to  bring  this  issue  to  a close. 

Again,  I appreciate  the  efforts  of  your  office  in  conducting  this  audit  in  a timely  and 
profession^  way. 


General  Manager 
JB/KR 

ATTACHMENT:  SFPUC  Response  to  Audit  Report  # 01061 

CC:  Michael  Quan 

Jeet  Bajwa 
Dwight  Steeves 


Cordially, 
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SAN  FRANCISCO  WATER  ALLIANCE 
RESPONSE  TO  THE  AUDIT: 


San 

Francisco 

Water 

Alliance 


e jml  ventuiB  ef 

Bethtel  Inlrosliuttiirc  Cor|ioi«tiDn 
The  JefieiJOB  Cowpony 
Svetdrup  Cirtl,  Inc. 


April  8.  2002 

Mr.  Edward  Harrington  - Controller 
City  & County  of  San  Francisco 
1 Dr.  Carlton  B.  Goodiett  Place 
San  Francisco,  CA  94102-4694 


Dear  Mr.  Harrington: 

We  would  like  to  thank  you  and  your  staff  including  Ms.  Carmen  LeFranc,  Ms.  Helen  Vo,  Mr.  Leon  Valle, 
Jr.,  and  others  for  this  third  review  of  the  SFPUC’s  Performance  of  Professional  Services  Agreement  with 
the  SFWA.  Since  the  completion  of  the  second  audit  last  year  we  have  endeavored  to  address  the 
recommendations  made  at  that  time  and  have  incorporated  all  of  your  suggestions. 

As  shown  in  Appendix  D of  your  report,  the  SFPUC  gave  the  Alliance  a total  score  of  149.1  out  of  a total 
possible  score  of  166.7  for  work  related  to  the  Year  2 task  orders.  This  is  equal  to  an  overall  score  of 
90%.  We  are  proud  to  have  achieved  such  a very  high  score  from  the  SFPUC  staff  and  it  has  been  our 
great  pleasure  to  have  had  the  opportunity  to  work  with  them  during  the  last  19  months. 

We  are  especially  pleased  with  our  report  card  on  the  tasks  performed  during  this  period.  It  has  been  our 
pleasure  to  model  the  Capital  Improvement  Program  and  bring  expertise  the  SFPUC  believed  was  critical 
to  the  CIP.  This,  together  with  Chloramination,  Reliability  Program  Phase  it!  and  Training  task  orders  to 
name  a few,  received  the  highest  rating  of  ‘excellent’  from  the  SFPUC.  As  you  have  noted  almost  50%  of 
the  task  orders  have  received  a rating  of  ‘exceeds  requirement  or  ‘excellent. 

We  appreciate  the  fact  that  you  have  agreed  with  our  position  regarding  the  satisfactory  completion  of  the 
audit  of  overhead  fees  earned  out  by  Bechtel  Infrastructure  Corporation  (BINFRA)  in  line  with  the  terms  of 
our  contract.  The  SFPUC  staff  member  who  audited  the  process  concluded  that  the  review  procedures 
performed  by  Bechtel's  internal  audit  department  appear  adequate  and  ftat  they  properly  support  the 
report’s  information.  As  you  have  noted  BiNFRA  performed  this  task  at  no  cost  to  the  SFPUC. 

We  are  happy  to  note  that  for  the  third  time  in  succession  your  audit  has  found  that  the  Alliance  generally 
complied  with  the  provisions  of  the  agreement  with  the  SFPUC  and  our  work  was  found  to  be  satisfactory. 
Your  audit  states  that  there  are  no  major  findings  regarding  our  performance  and  only  a few  minor  errors 
in  our  invoices  submitted  through  December  2001 , {an  over  billing  of  $7,730)  which  were  less  than  1%  of 
the  total  billings  sampled. 

The  over  billing  of  $7,730  that  you  have  referred  to  was  related  to  the  Alliance  billing  the  SFPUC  at  rates 
greater  than  the  maximum  rate  of  $140  per  hour  that  is  stipulated  in  the  contract,  for  some  specific  short 
time  work  effort  on  selected  tasks.  Engineering  and  subject  matter  specialists  from  the  Home  Office  were 
used  to  perform  specialized,  Optioneering  analysis  and  give  special  management  training  seminars  that 
could  not  be  provided  by  current  staff.  This  was  done  since  it  was  not  cost  effective  to  hire  and  add  this 
staff  to  the  Alliance  team  on  a fuii  time  basis.  We  believe  that  the  use  of  Specialists  from  the  Home  office 
on  an  as  needed  basis  is  in  line  with  the  terms  of  our  contract. 


In  reply,  please  refer  to:  CCN  01514 


Subject:  Response  to  the  Third  Audit  of  the  SFWA  Program  Management  Contract 


Permoneni  0fHt«;  333  fflorket  Streel,  14*  Floor  ■ Son  FroBtisco,  CA  94105  ■Tel:  415.768.0236  ■ Fox:  415.768.0241 
Proieef  OlfIcBj  875  5te»enion  Sfreel,  3'' Floor  .San  Frontisto,  CA  94103.  Tol:  415i54.7893.Fo*:  415J54.71B1 
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CCN  1514 
April  8.  2002 

Response  to  the  Third  Audit  of  the  SFWA  Program  Management  Contract 


Appendix  "D".  Financial  Terms  and  Conditions  of  our  contract  states  that  “Billing  rates  for  Consultant  staff 
“regularty"  assigned  to  the  project  shall  not  exceed  a maximum  hourly  rate  of  $140  per  hour  for  the  first 
year  and  such  rate  shall  be  adjusted  annually...”.  As  we  mentioned  before,  the  staff  in  question  were  not 
“regularly  assigned"  Alliance  staff  and  were  not  working  full  time  on  the  task  orders.  As  such,  we  believe 
that  their  rates  are  not  subject  to  the  rate  caps  of  regular  staff  and,  consequently  that  no  over  billing 
occurred. 

Once  again  we  would  like  to  thank  your  staff  for  performing  this  audit,  and  the  staff  of  the  SFPUC  for 
enabling  us  to  be  part  of  this  Capital  Improvement  Program. 

Should  you  have  any  questions  please  do  not  hesitate  to  contact  me  on  415-554-7678  or  SFWA 
Business  Manager,  Ann  Saha,  on  415-554-7680, 


Jeff  Brunetti  - Acting  Program  Director 
San  Francisco  Water  Alliance 
875  Stevenson  Street,  3"^  Floor 
San  Francisco,  CA  94103 


JJB/AS/fmc 


Enclosure 


cc:  Bajwa,  J 

Martel.  PE 
Quan,  ME 
Saha,  A 
Masri,  H 


Regards, 
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cc:  Mayor 

Board  of  Supervisors 
Civil  Grand  Jury 
Budget  Analyst 
Public  Library 
KPMG  LLP 


i 


